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Chapter  1 


Introduction 


1.1  Background  and  Previous  Work 

Classical  signal  detection  involved  centralized  signal  processing.  A  single  sensor 
was  employed  for  making  oljservations  which  were  pr<}C(!s.sed  coin.rally.  The  neefl 
for  increased  reliability  and  survivability  of  comrnimlcation  systems  has  led  to 
the  deployment  of  multiple  sensors  for  signal  detection.  Various  types  of  sensors 
are  utilized  to  observe  the  environment.  The  collected  data  is  sent  to  a  central 
proces.sor  where  classical  hypot,iiesi.s  testing  procedures  are  employed  for  cignal 
j)roct!ssiiig  fl,  3],  Processing  of  observations  is  done  only  at  the  central  proces¬ 
sor.  Hence,  sxrch  communication  systems  are  still  centralized.  Tlux  transmission 
of  ohserx'ations  from  the  sensors  requires  communication  channels  with  large  com¬ 
munication  bandwidth.  Moreover,  the  computational  load  at  the  central  processor 
increases  unfavorably  due  U;  the  increi  se  in  the  mimber  of  observations  to  be  pro 
cessed.  Naturally,  the  uf!ed  for  di.stributing  the  procxrssing  at  tli«;  sensors  was  felt, 
thereby  increasing  the  interest  in  the  area  of  decentralized  detection.  Depending 
on  the  Ixandwidt.lt  constraints  of  the  counnunication  (:hHnnf;ls,  some  signal  process- 


[ 


ing  Is  appropriately  assigned  to  the  peripheral  sensors.  These  peripheral  detectors 
perform  some  signal  processing  locally  and  transmit  the  results  to  a  fusion  center 
responsible  for  obtaining  the  final  result. 

The  distributed  detection  system  shown  in  Figure  1.1  has  been  considered  quite 
extensively  in  the  literature.  The  system  consists  of  n  local  detectors  observing 
the  environment.  Each  local  detector  makes  a  decision  concerning  the  hypothesis 
present  based  on  its  observations,  Local  detector  decisions  are  then  transmitted  to 
the  fusion  center  where  they  are  combined  to  yield  a  global  decision.  The  decen¬ 
tralized  detection  systems  have  been  investigated  using  various  approaches  such  as 
the  Ba}'esian  approach,  the  Ney man- Pearson  approach,  the  min-max  criterion  and 
the  Sequential  Probability  Ratio  lest  [4]-[l6].  Tenney  and  Sandell  [4]  considered 
a  distributed  detection  system  with  a  fixed  fusion  center.  They  used  the  Bayesian 
approach  to  optimize  a  system  consisting  of  two  detectors  with  independent  ob¬ 
servations.  Sadjadi  [,‘i]  extended  Tenney  and  Sandell’.s  results  to  n  detectors  and 
M  hypotheses,  (yhair  and  Varshney  [6]  used  the  Bayesian  approach  to  optimize 
the  fusion,  center  with  fixed  local  detectors.  Hoballah  and  Varshney  [7]  presented  a 
generidized  Bayesian  formulation  of  a  decentralized  detection  system  with  a  fusion 
center.  Using  the  Person-By-Person-Optimal  (PBPO)  uuithodology,  they  derived 
tin;  local  detector  and  the  fusion  center  decision  rule;s.  Reibnioai  and  Nolte  [8]  con¬ 
sidered  a  dec<  ntralized  detection  system  with  non-Oaussian  noise.  In  [9],  Reibni.au 
and  Nolte  considered  the  general  design  and  performance  of  several  distributed  rle- 
tcction  system  structures.  Lauer  and  Sandell  [10]  used  the  Bayesian  approach  to 
optimize  the  distributed  detection  system  with  depeinient  observations  at  the  local 
detector.s.  Ekchian  .ind  Tenney  [11|  oiitimized  the  tandem  topology  and  various 
other  system  configurations.  A  simulation  .study  of  a  spt:c.ific  decentralized  detec¬ 
tion  system  was  conducted  by  Kushner  and  Pacut  [12].  'L’eneketzi.s  [13]  develoiied 
;i.  decentralized  version  of  Wald’.s  sequential  (.letectiou  problem.  In  addition,  he 
coii-sulcred  t.ho  quickest  detection  [iroblem  in  [H].  brinivasau  [IJi]  considerefl  the 


Fig.  1 . 1 :  A  (iKcentTcilizcd  detection  system 


Neyman-Pearson  approach  for  optimizing  a  decentralized  detection  system  with  a 
fixed  fusion  rule.  Viswanathan  and  Thomopoulos  [17]  considered  the  two  detector 
serial  system  and  showed  that  it  outperforms  a  parallel  system  with  two  detectors 
and  a  fusion  center.  Papastavrou  and  Athens  [1 9]  considered  the  tandem  topology 
and  derived  cisymptotic  results  for  a  serial  system  of  n  detectors.  Tsitsiklis  [21] 
disciissed  th.;  advances  in  decentralized  detection  systems,  computational  issues 
and  asymptotic  results. 

In  most  of  the  above  work,  information  avciilable  to  a  local  detector  consisted 
of  it’s  observations  of  the  envirotiment.  Recently,  Srinivasan  [26]  considered  the 
availability  of  additional  information  such  as  the  previous  global  decision  at  the 
local  detectors.  He  used  the  Neyman-Pearson  approach  to  optimize  a  decentralized 
detection  system  with  feedba^dc. 

In  this  dissertation,  we  consider  the  decentralized  detection  system  with  Ised- 
back  shown  in  Figure  1.2  and  several  variations  from  a  Bayesian  viewpoint.  This 
system  consists  of  n  local  detectors  collecting  observations  fron^  the  enviroiunei't. 
Each  local  detector  makes  a  decision  regarding  the  hypothesis  present  based  on 
the  collected  observations  and  the  previous  global  decision.  These  local  decisions 
are  transmitted  to  the  lusion  center  where  they  are  combined  to  yield  a  global  de- 
cis’or  The  global  decision  is  transmitted  ba.ck  to  all  local  detectors  to  aid  tiicni 
in  their  decision  process.  In  addition  to  the  study  of  the  decentralized  detection 
system  with  feedback,  we  will  present  a  unified  approach  to  the  design  and  study 
of  decentralized  detection  systems. 

There  are  two  major  contributions  of  this  dissertation.  The  first  one  is  the 
demonstration  of  the  fact  that  the  performance  of  a  decentralized  detection  system 
can.  be  improved  by  the  use  of  feedback,  T.his  improvement  is  achieved  at  the 
expense  of  increased  communication.  The  other  major  contribution  is  a  unified 


representation  of  decentralized  detection  system  with  ctny  topology  along  with  an 
approach  to  obtain  the  PBPO  decision  rules  at  any  detector  of  the  decentral’ ■■led 
detection  system. 

The  general  model  for  the  decentralized  di?tection  problem  con.sists  of  the  fol¬ 
lowing  principal  ingredients: 

1.  A  set  of  random  variables  i  =  0,1,...,  M-1;  j  —  1,2, ...  ,n}  that 

represent  all  the  uncertainties  in  the  problem  and  their  distributions.  The 
first  variable  represents  the  hypothesis,  and  is  denoted  by  Hi,  i“0,l,.  .,,M'l. 
The  other  random  variable  is  the  noise  present  in  the  environment  denoted 
by  Oj,  j=l,2,..  .,n. 

2.  A  set  of  observations  Y~{yi,2/2» •  •  •  > 2/n}  which  am  given  functions  of  the 
hypothesis  present  and  the  noise.  In  general,  y,-,  i=l,2,. .  .,n,  is  a  vector  and 
is  the  observation  available  to  the  deci'.’,''->n  maker  (detector).  From  the 
given  distribution  of  the  noise  9,  the  conditional  piobability  density  function 
p{yi\Hj),  j--0,l,. .  .,M-1,  is  also  known. 

3.  A  set  of  decision  variables  U— ^2)  •  •  •  > 'Ai}  where  each  tf,-  reprfisents 
t}i  decision  of  the  decision  maker.  Thr  decision  u,,  i— 0,1,2,. .  .,n,  is  to 
take  values  appropriate  to  the  decision  space  specified  '^3^  the  problem.  In 
this  formulation,  Uq  is  the  glol'al  decision. 

4.  A  set  of  decision  rule.s  F  ■—  {711,71,7?,..  •  ,7n},  one  for  each  deel.rimi  irwiker 
(Including  the  fusion  center),  where  7,-  is  a  mapping  from  the  observation 
.space  to  the  decision  space,  i.e., 

and, 

^^0  -  ro(Ml,W2>---,«n)- 
(1 


5.  A  cost  (payoff)  function  L{uq,  Hj)  where  uq  is  the  final  decision  of  the  system 
and  Hj  is  the  hypothesis  present. 

The  problem  in  decentralized  detection  systems  is  to 
Find  7,-  in  F  ,  for  all  i  such  that 
js  minimized. 

In  the  next  section,  we  present  the  dissertation  organization. 

1.2  Disaertation  Organization 

In  this  dissertation,  we  focus  our  attention  on  the  decentralized  detection  system 
with  feedback  shown  in  Figure  1.2.  In  Chapter  2,  we  describe  the  decentralized  de¬ 
tection  system  with  feedback  in  detail  and  establish  some  initial  results.  Using  the 
Person-By-Person-Optirnal  (PBPO)  methodology  from  a  Bayesian  viewpoint,  we 
derive  the  decision  rules  of  the  local  detectors  and  the  global  decision  maker.  The 
optimum  test  at  the  local  level  1.5  shown  to  be  a  likelihood  ratio  test  fur  statisti¬ 
cally  independent  observations  at  tlie  local  detectors.  The  number  of  observations 
is  not  assumed  to  be  known  a  priori.  Hence,  optimization  of  this  system  is  done 
for  each  time  step  t.  In  other  words,  it  is  as.sumed  that  the  knowledge  of  the 
stopping  time  as  to  when  the  final  decision  is  to  be  made  is  not  available.  The 
local  thre.shold  etpiation  is  a  function  of  the  previous  global  decision.  The  perfor¬ 
mance  of  the  system  is  deiivea.  In  the  remainder  of  the  chapter,  we  assume  that 
tb.e  stopping  time  of  tlie  decision  pcooess  is  known  a  priori,  i.c.  a  known  number 
of  observations  are  available^  at  each  detector  for  processing.  Thi.s  is  identified  a.s 
the  Fixed  Sa.niple  Size  (FSS)  probltan.  Here,  the  PBPO  solution  methodology  is 
again  used  and  tbe  .system  performance  is  optimized  liy  taking  into  account  the 
stopping  time.  We  derive  the  PPFO  decision  rule:)  both  at  the  loca.l  detectors  and 
at  the  fusion  center  for  the  fixed  sample  size  problem.  In  add!  1, ion,  we  ci'nsider  a 
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detection  system  having  a  single  detector  with  feedback.  We  derive  the  detector 
decision  rule  for  the  FSS  problem.  We  establish  the  correspondence  between  the 
single  detector  system  with  feedback  and  the  serial  system  thereby  allowing  us  to 
utilize  our  results  for  the  single  detector  system  with  feedback  to  serial  networks. 
Furthermore,  the  results  of  the  decentriilized  detection  system  with  feedback  are 
extended  to  more  complex  networks  of  serial  nature.  Thus,  we  provide  a  novel 
approach  for  the  design  and  analysis  of  serial  networks.  Examples  are  presented 
throughout  the  chapter. 


In  Chapter  3,  we  consider  a  decentralized  detection  system  with  feedback  and 
introduce  memory  at  the  local  detectors,  allowing  them  to  store  all  previous  ob¬ 
servations.  Using  the  Bayesian  approach,  we  derive  the  PBPO  solution  for  the 
decision  rules.  We  show  that  the  proposed  system  outperforms  the  conventional 
distributed  detection  system  and  the  .system  without  memory  considered  in  Chap  ¬ 
ter  2  when  more  than  one  observation  sample  per  detector  are  taken.  Asymptotic 
results  for  this  system  are  obtained  and  the  probability  of  system  error  is  shown 
to  go  to  zero  asymptotically,  An  important  issue  that  arises  in  the  decentralized 
detection  system  with  feedback  is  that  of  data  transmission.  Due  to  the  fecidback 
links  from  the  global  decision  maker  to  the  local  detectors  ,  there  is  an  iimrease  in 
communication  or  data  transmi.ssion.  Two  protoct)ls  are  proposed  and  studied  to 
achieve  the  desired  reduction  of  data.  tran.smi.ssion.  We  show  that  the  use  of  tlie 
propo.sed  protocols  reduces  coi.umunication,  on  an  average,  to  zero  asymptotically. 
In  otlier  word;  ,  on  an  average  no  transmission  of  decisions  is  necessary  among  the 
system  detectora  asymplutically.  An  example  is  presented  to  illustrate  tlu;  results 
obtained. 


In  Chapter  4,  we  consider  the  design  of  a  decentralized  detection  system  with 
an  arbitrary  topology.  Inspired  by  IIo’s  definition  of  information  structure  [22],  we 
dei'ue  the  (:oirnuuuic;i,tion  strn  ;ture  of  a  systmu.  Using  this  flefinitibn,  (hu:('ntral- 
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ized  detection  systems  could  be  represented  in  terms  of  a  conirnunicai.ion  matrix 
which  shows  the  transmission  paths  of  detector’s  decisions  in  a  given  system.  We 
show  the  applicability  of  this  definition  to  our  study  of  the  design  of  decentralized 
detection  networks  with  arbitrary  topologies.  We  generalize  the  definition  of  the 
communication  matrix  to  enable  us  to  study  systems  with  feedback  such  as  those 
in  Chapters  2,  and  3.  Finally,  using  the  PBPO  solution  methodology,  we  present 
a  general  approach  for  the  derivation  of  decision  rules  for  the  FSS  problem.  We 
consider  a  number  of  examples  and  show  that  results  available  in  the  literature 
can  be  obtained  using  this  general  design  approach.  The  generalized  definition  of 
the  communication  matrix  and  the  general  approach  to  the  design  of  decision  rules 
provide  the  necessary  and  sufficient  tools  for  the  study  of  decentralized  detection 
systems  with  arbitrary  configurations. 

In  Chapter  5,  we  present  a  summary  and  discuss  the  results  obtained  in  this 
dissertation.  Some  directions  for  future  reseai’ch  are  also  provided. 


Chapter  2 


The  Bayesian  Formulation  of  a 
Decentralized  Detection  System 
With  Feedback 


2.1  Introduction 

Tlu!  area  of  decentralized  detection  ha«  been  studied  extensively  in  the  litera¬ 
ture  recently.  Decentralized  detection  .sy.steins  have  been  ])roj)osed  and  investigated 
using  various  approaches  such  as  the  Bayesian  approach,  tht;  Ncyinan- Pearson  ap¬ 
proach,  the  min-max  criterion  and  the  Wakl’.s  Sequential  Probability  Ratio  Test 
[d]-[15].  Sriniva.san  [26]  and  Alhakccm  ct.  al.  [27]  have  recently  investigated  a  de- 
c<;ntraHzed  detection  system  with  feedback  u.sing  the  Neyinan- Pearson  approach. 
I'liis  was  nu)l,iv.'i,ted  by  result.s  such  as  [20]  wliere  it  lias  been  shown  that  improved 
channel  capacity  is  achievixi  when  a  feedback  link  is  employed.  In  tliis  chapter, 
we  study  a  decentr  ,lized  detection  system  with  feedback  using  the  Baye.sian  for- 
uiulatioa.  Tu  thi.s  system,  the  global  (hxTsion  .at  time  .step  t  is  fed  lu-iH'-  to  alt  local 
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detectors.  Local  detectors  in  turn  operate  on  their  observations  as  well  as  the  re¬ 
ceived  global  decision  to  yield  local  decisions  at  time  step  t-t-1  which  are  then  sent 
to  the  fusion  center.  A  detailed  description  of  this  system  is  given  in  Section  2.2. 
In  Section  2.3,  we  derive  the  decision  rules  at  the  local  detectors  and  the  fu.sion 
center  using  the  PBPO  solution  methodology.  I'he  number  of  observations  is  not 
assumed  to  be  known  a  priori  and  the  optimization  is  done  for  each  time  step  t. 
Probability  of  system  error  is  derived.  In  Section  2.4,  we  consider  the  Fixed  Sam¬ 
ple  Size  problem  (FSS)  where  we  have  an  a  priori  knowledge  of  the  stopping  time 
t=T  at  which  the  final  decision  is  made,  i.e.  the  number  of  observations  is  known 
a  priori.  The  system  is  optimized  in  such  a  manner  that  the  system  performance 
is  optimum  at  th<-  stopping  time  t=T.  We  formulate  the  FSS  problem  using  the 
Bayesian  approach  and  derive  the  global  and  local  decision  rules  for  any  time  t<T 
and  t=T  that  minimize  the  average  system  cost  at  time  t— T.  In  Section  2.5,  we 
consider  the  single  detector  system  with  feedback  and  derive  the  decision  rules  for 
the  FSS  case  using  the  Bayesian  formulation.  In  Sectioji  2.6,  we  .show  that  the 
single  detector  sy.steru.  witli  feedback  is  equivalent  to  a  serial  system  where  the 
time  .step  t  is  the  same  a.s  the  stage  number  n  of  the  serial  system.  Hence,  a  deceir- 
tralized  detection  sy.stem  with  f(!<xlback  C'^dd  be  viewed  as  a  seriiil  sy.stem  with  n 
l^locks  in  aeries  where  each  block  consists  of  local  detwdur.s  and  a  fusion  center.  In 
.Section  2.7,  we  discuss  the  results  of  this  chapter,  (t  i.s  noted  that  even  when  the 
stopping  time  i.s  known  a  priori,  the  decentralized  detection  system  with  feedback 
considered  in  tins  chapter  cannot  outperform  the  decentralized  de.tection  sy.stem 


without  feedback  th.at  h-as 


studlv'-.!  CXtCjiSIvdy  tJ  t  tiht^  Jl iit'i  (i. (i i 


examples  are  prefjented  throughout  the  chapter  for  illustratiou. 


2.2  System  Description  and  Problem  Statement 


We  consider  the  binary  hypothesis  testing  problem,  with  the  two  hypotheses  de¬ 
noted  by  Hq  and  H\  respectively,  for  the  system  shown  in  Figure  2.1.  This  system 
consists  of  n  IocaI  detectors  which  communicate  their  decisions  to  a  fusion  cen¬ 
ter.  At  time  step  t,  we  denote  the  observation  sample  at  the  detector  by 

A  =  1, 2, . . . ,  n,  and  the  local  detector  decision  Is  denoted  by  nj.,  k  —  1, 2, . , . ,  n 
The  global  decision  at  time  step  t  is  denoted  by  Uq.  The  k*^  detector  takes  an 
observation  y\  at  time  step  t,  and  based  on  its  present  observation  and  the  previ¬ 
ous  global  decision  makes  the  local  decision  u\  and  transmits  it  to  the  fusion 
center.  The  fusion  center  combines  the  incoming  local  decisions  u\,  k=l,2,  . . .,  n 
and  generates  the  global  decision  Uq  which  is  sent  to  all  of  the  local  detectors. 

We  assume  that  the  joint  conditional  probability  density  functions 
p{y[,y2, .  • . ,  J/^ i  =  0, 1  are  known  a  priori.  Each  local  detector  uses  a  decision 
rule  denoted  by  7jt(.)  to  make  a  decision  such  that  for  k=l,2,. . .  ,n,  we  have  the 
local  decisions 


.Similarly,  we  denote  the  global  decision  rule  by  7o(-)  and  the  glol.ial  decision  is 
obtaiiicfl  as 

< = 7, ;('/') 

where  (P  —  {v.\,  . . . ,  uj,)  is  the  vector  of  local  detc’ctor  decisions. 

The  problem  i.s  to  find  the  PUPO  deci.sion  rules  7j[.(.)  for  each  detector  k, 
k— 0,1,2,. . .  ,n,  so  ay  to  niiiiimizc  the  Bayc-siau  cost  funetion  J(T)  ,  where 

r-.  {r*  ;f  ^  1,2,...}. 

r‘  -  {-y^(.):A:=:n,l,...,n} 


I  X 


Here,  1'‘  is  (iefined  as 


Fig.  2,1:  A  decentralized  detection  system  with  feedback. 


The  optimization  of  this  system  is  carried  out  using  the  Person- By- Person  opti¬ 
mization  procedure  for  this  team  decision  problem  [25].  This  system  will  be  viewed 
as  a  team  consisting  of  two  members.  One  team  member  is  the  fusion  center  and 
the  second  team  member  is  the  aggregation  of  the  individual  detectors.  The  second 
team  member  can  be  further  viewed  as  a  team  where  individual  detectors  are  as¬ 
sumed  to  be  tea,m  members  within  their  aggregate  team.  The  equations  resulting 
from  the  person- by-person  optimization  represent  necessary  conditions  but  not,  in 
general,  sufficient  conditions  to  determine  the  globally  optimal  solution  [25].  These 
equations  are  solved  simultaneously  to  obtain  the  .solution. 


In  the  Bayesian  approach,  we  assume  the  knowledge  of  the  a  priori  probabilities 
p{IIo)  and  p{Hi)  .  In  addition,  the  cost  of  deciding  Uo  =  Hi  when  the  true 
hypothesis  is  Hj  is  denoted  by  ('7,j  i,j=0, 1,  and  assumed  to  be  known  a  priori.  Tlie 
Bayesian  cost  function  to  be  minimized  can  be  written  as: 

./(r‘)  =  CoopK  =  0,  //o)  +  Coipiul  =  0,  /TO 

+Cmp{n^,  =  1,  Ho]  +  -  1,  T, )  (2.1) 


Denote  the  system  probability  of  false  alarm  p(uq  -  l|//o)  and  tlie  .system  prob¬ 
ability  of  detection  p(uy  :=  l|//i)  by  and  p‘^^  respectively.  Rewriting  (2.1)  in 
terms  of  pj^  ami  we  liave; 


/(r‘)  =  6V;4  -  +  6' 


(2.2) 


where 

Cf  —  P{Hq){Cio  —  ri'lHj) 

(yj  ii[  ■  •  (..'ii 

C  -■  p(  //())(7(J0  +  p{Hi)(Joi 

It  i:;  ;L.ssumod  that  m.aking  a  wrong  decision  is  more  costly  than  making  a  correct 
deci.sion.  'I.'hi.s  implies  that  (Jf  and  are  gi'eater  then  zero  since  6\o  >  T’lxi  aiul 
fan  >  frii-  the  next  .section,  we  proceed  witli  the  .systenr  optimization  and 
perfonnaiic.e. 


2.3  System  Optimization  and  Performance 


In  this  section,  we  utilize  the  PBPO  solution  methodology  to  minimize  the  Bayesian 
cost  tunction  in  Equation  (2.2).  In  Theorem  2.1  we  derive  the  global  decision  rule 
7o(,).  The  local  decision  rules  are  derived  in  Theorem  2.2.  Before  proceeding  fur¬ 
ther,  we  assume  that  the  observations  at  the  local  detectors  are  statistically  inde¬ 
pendent.  Therefore,  the  a  priori  knowledge  of  the  conditional  probability  densities 
reduces  to  the  a  priori  knowledge  of  the  individual  detector 
conditional  probability  densities  i  =  1, 2, . . . ,  n;  j  =  0,1.  Theorem  2.1  is 

presented  next. 

THEOREM  2.1 

For  the  decentralized  detection  system  with  feedback,  the  PBPO  fusion  rule 
for  the  Bayesian  biirary  hypothesis  testing  problem  is  given  by 

0  otherwise  (2.11) 


where  the  likelihood  ratio  A{U^)  Ls  given  by 

AUVh) 


A(f/‘)  - 


pmfio) 


Proof: 


Consider  the  cost  function  in  Plqnacion  (2.2).  V/e  expand  the  pi  oijability  oi  false 
alanij  and  the  juobability  of  detection  aronud  the  decision  vt;ctor  (/‘  as  follows, 

r/‘  J/' 

Conditioning  on  and  expanding  we  get 

-  c^/EpAu  -  iK/M7o)p(c/'|/^o)  -CuEpAo  -  i.K/‘,/C)p(r/V/i)  t-c\ 


U' 


Since?  Uq  given  T/*  does  not,  depend  on  the  hypothesis  present,  we  rewrite  the 
previous  expression  as; 

An  -  Ep(“o  =  -  np{U^\H\)]  +  C.  (2.4) 

w 

Due  to  the  PBPO  methodology  being  employed,  we  assume  that  the  local  detectors 
are  fixed  and  minimize  ti':;  cost  function  J(r‘)  by  choosing  the  decision  rule  at  the 
fusion  center  as 

p(u‘  =  -  1,  i.J  Cjp{W\Ih)  ~  Qp(f/*|//i)  <  0 

0  otherraise 


which  is  the  desired  global  decision  rule  7o(C^*)  giveji  in  (2.3). 


Q.E.D. 


THEOREM  2.2 


The  PBPO  deci;don  rule  at  the  local  detector  for  the  Bayesian  binary  hy- 
pi)thesis  testing  problem  is  given  by 

71(4,"!,-') -4=  1,  (2-=) 

0  nthtmn.'^e 

wh(!re  is  the  flctector  tlireshoid  at  timi;  st(;p  t  defined  as: 


Em  /ii)p(unun 


Ul  :  {u{,  ul,, . . . ,  u\,  , . . . ,  It),)  the  local  detector  decision 

vector  v7*  excluding  the  n  detector  deensiou. 

1/;),  :  ,  ii],  ■—  i,. . .  ,7j)J  local  detector  dechdoii  vcct(;''  lA 

with  the  A''  det<v:tor  deci.sion  ti],  e<pial  to  i,  i;  0,1. 


If) 


Proof; 


We  rewrite  expression  (2.4)  explicitly  in  terms  of  the  local  decision 

./(r')  =  E  /’("o  -  WDlCfPm^m  -  CMUl,\ih}] 

+p{i‘h  =  1  WUmviutjH,,)  -  CMUlolih)]  +  c.  (2.7) 

It  should  be  observed  that  the  summation  above  is  o'/er  all  the  possiblities  of  the 
decision  vector  .Substituting  piUl„\Hj)  =  p{!Jl\flj)  —  p{Uli\fIj)  ,j— 0,1  in  (2.7) 
and  factoring  out  <'onunon  ternw,  we  have; 

7(r‘) ...  5:  P(u(,  m,)[CfPiui,\Ho)  -  c,iP{uu\ih)] 

■  ■!>{<  -  WfloWflWxW  -  Cap{VU\lh)] 

+p{A  =  mDiCfPmH^)  -  cup{ui\H,))  +  a 

Factoring  the  ter-.n.s  in  square  brackets  out, 

A(hpv^n^"o) -- (iiP(uu\ih)] 

- \\UU){CjpmU,)  -  C,p{Ul\U,))  +  a  (2.8) 

Observing  tliat  the  last  two  terms  are  not  involved  in  tin;  optiiui/ation  of  tin; 
local  detector  diu;  tcj  the  PllPf)  procedure  being  employed,  we  drop  tlios<;  terms 
in  the  subseciueut  eciuations  and  denote  tin,*  new  co.st  function  by  ./^(P'*).  Next,  we 
exi)and  J^(I'‘)  in  n^~\  the  previous  global  decision,  and  Y‘  -  [jA,  !jt,  ■  ■  ■  ^  III)  the 
observation  vector  of  local  detectors: 

-  E  [p«  -  miv)  -  pi’A,  - 

■■-c.iPWU.<\yvh)]. 

i  / 


(2.0) 


For  notational  convenience,  we  assunne  that  the  integration  is  over  the  appropriate 
variables  indicated  with  the  integral  sign  /  and  the  term  dY*  will  not  be  v/ritten 
explicitly.  This  convention  is  followed  throughout  the  dissertation.  Letting 
p(uq  =  —  p(ito  ~  ~  /(^fc)s  expanding  (2.9)  by  conditioning  on 

and  Y'  .,  we  have, 

=  Y.  mi)  Iy^  Ho)piu^o~\  ym^) 

-CMUM-\y\Hx)p(ul-\Y^H,)].  (2.10) 

The  local  decision  vector  Ul^  given  both  the  previous  global  decision  and  the 
observation  vector  Y^  does  not  depend  on  the  hypothesis  Hj,  j=0,l.  In  addition, 
assuming  the  observations  are  independent  in  time,  the  previous  global  decision 
Uo~^  is  independent  of  the  observation  vector  Y^.  We  rewrite  (2.10)  as: 

-  Ymi)  fv< r)pinmHo)p{r\Ho) 

-c,p(uiM'\y‘)p(4-'\mpiymi)]-  (2.11) 


Moreover,  assuming  that  the  observations  at  detectors  i  and  j,  iy^j,  are  independent . 
of  each  other,  Equation  (2.11)  is  rewritten  as, 


^'(r*)  -  E  mi)  fv<  [C/p«’|//o)p(t/‘i|t4-\  y^)p(yilHo) 


n  p(”ii'4  ^?/^)p(p<l^^o) 

-exu'-v/.)  p((/Lim,pi)P(pmi) 

n  p(^ii4''bPi)p(yiU''^'i)]- 


(2.12) 


Factoring  out  the  term  p(17aiI'^o  \.pD  >  have 

“'■(I”)  =  E  n.r‘  /(‘'Oh 
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where  :  (j/l , ya ? •  >  •  > !/l-i > yi+i T-’iVh)  observation  vector  excluding 

thj  (ietector  observation. 

Integrating  over  and  rearranging  (2.13)  we  have, 

=  E  k  mi) 

~-CM<'\ni)pm\4-'Jh)p(yl\l-h)h  ( 

To  minimize  the  cost  function  given  by  Equation  (2.14)  we  choose 

P(^A-th4“Si/]t)  --  1  '^1  >  ^0 

0  otherwise 


where 


/io  =  E/(^fc)^^VP(?/Jl-|/fo)p(tir'|ffo)p(/7/.h4-\  Ho) 


Th<3  k^''  detector  dticision  rule  therefore  is  given  by  rewriting  (2.15)  as: 

PiVklH)) 


PivllHo) 

0  otheruhsK 


>  pI(^4  ) 


where  r/[(no  ')  is  the  detector  threshold  at  time  step  t  defined  a.s: 

Q Eurf(^Dp(HlK  \  H,}p(unHi) 


as  stated  in  Equation  (2.6). 


.14) 


(2.15) 


(2.16) 


(2.17) 


Q.E.D. 


At  time  .step  t;-d,  there  i::  lu)  feedback.  At  this  step,  tlie  fusion  rule  luu;  the 
same  form  as  given  in  4’ln;ov(un  2.1.  llowcwer,  the  local  def.i.sion  rules  are  sin.gle 
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threshold  likelihood  ratio  tests  given  by 


1, 

0 


pjylWx) 

Pi.ykWa) 


>4 


otherwise 


where  77^  is  the  detector  threshold  at  time  step  1  defined  as: 

crzuimMuiiH,) 

mi)  -  p{4  -  i\ui  - 1)  -  -  mi  =  0). 


(2.18) 


(2.19) 


From  Theorem.s  2.1  and  2.2,  the  following  observations  regarding  the  decen.' 
tralizcd  detection  system  with  feedback  c.an  be  made: 


•  The  optimum  test  at  a  local  detector  is  a  likelihood  ratio  t(3.st  for  statistically 
independent  observations. 

•  The  local  detector  threshold  t]1{uq~^)  i.s  a  function  of  the  previous  global 
decision  Hq~^  as  given  in  Equation  (2.6).  For  the  binary  hypothesis  testing 
j  oblem,  two  tlircshold.s  exist  since  the  pnwious  global  deci.sion  takes  two 
values.  The  thresliold  7/[.(uo"'‘)  i.s  also  a  function  of  tlie  probabilities  of  syfice\n 
false  alarm  ami  miss  at  the  previous  step,  namely  and 

•  .At  every  tiin.  st(q)  t,  there  are  2“  fusion  rule  equations  and  2ii  local  threshold 
equation:-;  to  be  solved  for  the  binary  liyputhesi.s  testing  problem. 

•  .Since  the  local  detector’s  thresholds  change  from  one  time  step  to  the  next, 
the  optimum  finaoa  rule  change:^  as  well. 


liystcni  Performance 


Next,  we  consider  the  perfoniumee 


of  the  deeeutralixed  detc;ction  fiysteni  with 
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feedback.  In  the  general  case,  the  performance  is  described  in  terms  of  the  Bayes 
co.st  J(r)  given  in  Equation  (2.2).  Here,  however,  we  con.sider  the  special  case  of 
minimum  probability  of  error  criterion,  i.e.  f7oo  =  Cti  =  0  and  Cqi  =  Cio  =  1,  and 
characterize  the  system  performance  in  terms  of  the  system  prob.ability  of  error 
denoted  by  pf „ .  The  system  probability  of  error  is  given  by 

+  (2.20) 

where  is  the  system  probability  of  miss.  Wc  expand  p^^  defined  ;ls  p(riQ  —  1 1  Uq) 
in  terms  of  Uo”', 

4  -  vH  -  u  ffo)p(4-'  -  mo) 

-hp04  =  iK'"  =  0,  //n)p(u^,-'  -  0|//o).  (2.21) 

Replacing  p(u!r^  0|fio)  by  1  -  pinf,"'  ~  l|//())  and  rtuirranging  terms,  we  have 

p%  -  pom  -  lK^)b("o  ~ 

~-p(u‘o  -  l|uo“‘  -  0,  Ifo)]  4-  p(nfi  -  =  0,  ,Wn). 


I'his  may  be  rewritten  as: 


=  i)  -p^(u?r'‘  -  0)]  0) 


(2.22) 


where 

P/niK'^  ~  ;■)  =  p04  ~  '•h^o  ~  0  //n). 

Introducing  the  local  decision  v(;ctor  IP  iu  the  above  expressioii,  we  have 

PiSm  ^  0  -  p0‘o  -  I  h^h))  ■■= 

yiu^pK  -  i\u\ul\  [hMrmm  -  tPo).  (2.2:1) 

Ob.serviug  that  the  global  deei:;lt>n  nf,  conditioned  on  IP  doers  not  depend  on 
and  //y,  Kepiation  (2. 2.'!)  yields 


4)  ->:p(n^:  lK7‘)p(?/1<-' 


Hu). 


(2.24) 


Similarly,  the  probability  of  system  miss  is  written  as: 

-  P!a">L  (<■'  =  --  =  1)1  + 

where  the  probability  of  system  miss  p^oC'^^n  ^  ~  0  is  expressed  as: 
Pmc(“o~^  =  0  ^  pKi  =  0|«o~‘ 


(2.25) 


(2.26) 


Substituting  Equations  (2.22)  and  (2.25)  in  (2.20),  we  obtain  the  probability  of 
system  error  p*^.  At  time  step  t— 1  the  system  probability  of  error  is  given  by 


pL  =  P/oP(  ^o)  +  pLoP(  1 ) 


(2.27) 


where 


p/„-Ep(“o  =  iK/‘)p(C^'I^4) 

U' 

rn 

Next.,  we  consider  an.  example  whore  .some  iinmerical  results  are  obtainetl. 


Example  2.1 

We  consider  a  .system  consisting  of  two  local  detectors  and  a  fusion  center. 
'The  binary  hypothesis  testing  problem  is  con.sid*  red.  Undt;r  both  hypolhc'ses,  the 
input  observations  at  ea.ch  detector  arc  a:i.sumed  to  have  a  Rayleigh  distribution. 
For  .simplicity,  the  sigii.d-to-iuhse  ratio  (SNR)  at  the  two  detectors  is  a.s.sumed  to 
be  equal  and  is  denoted  by  e.  As  .shown  by  DiFnanco  and  Rubin  [28],  for  l.lii.s 
model,  the  probability  of  f.dse  alarm  and  1.1k;  probability  of  detection  are  given  by 

^  (([  +  £) 

and, 

Pd, 


aA>»<uisAift*lhU  Bc  M  VASuaK  ft::uukMiaal£fiEM  lt  a  ;cinus(SftVJa''.afa 


The  above  equations  in  addition  to  Equations  (2.19),  and  (2.27)  are  used  to  eval¬ 
uate  the  system  probability  of  error  ami  thresholds  at  time  t=l.  The  results  are 
then  used  in  Kquations  (2.6),  (2.20),  (2.22), (2.25)  to  obtain  the  system  probability 
of  error  and  thresholds  for  t>l.  The  minimum  probability  of  error  criterion  is 
assumed,  i.c.  ,  Cqq  —  C'n  —  0  and  Coi  =  Cio  =  1-  Also,  the  priori  probabilities 
are  assumed  to  be  equal.  In  this  cxamph’.  wc  consider  two  tusion  rules  namely 
tlie  OR  and  the  AND  fusion  rules.  For  the  OR  fusion  rule,  we  plot  the  threshold 
values  r]f.{uo~^  =  0)  and  r/],(Uo~'  =  1)  vs.  SNR  for  different  values  of  t  in  Figures 
2.2  and  2.H  respectively.  The  probability  of  system  error  vs.  SNR  for  different 
values  of  t  is  plotted  in  Figure  2.4.  Similarly,  for  the  AND  fusion  rule,  we  plot  the 
tlireshold  values  —  0)  an<l  —  1)  vs.  SNR  in  Figures  2.5  and  2.6 

respectively.  The  probability  of  .system  error  pj.^  vs.  SNR  is  plotted  in  Figure  2.7. 

T’he  plot  in  Figure  2.2  shows  that  the  threshold  ?/[.(U(*)~*  =  6)  increases  as  a 
function  of  time  ajid  as  a  function  of  SNR.  The  plot  in  Figure  2.3  shows  that  the 
threshold  r/{,(uo~^  =  I)  decreases  as  a  functifm  of  time  and  as  a  function  of  SNR. 
As  SNR  goe.s  to  infinity,  the  thre.sh.old  r/[(uu~'  ~  1)  Pioas  to  zero  and  -•  0) 

gociH  to  infinity  .  d'he  plot  in  Figure  2.4  .shows  that  the  probability  of  system  error 

decreases  as  a  function  of  time  and  as  a  function  of  SNR  as  (Expected.  It  can 
l.)e  observed  that  goes  to  zero  as  SNR  value  increases  t(j  infinity  and  as  time 
step  t  goes  to  infinity  .  For  the  AND  r\d«',  the  tlinssiiolds  and  the  probability  of 
.system  (■rror  shown  in  Figures  2.5,  2.(5  and  2.7  follow  a  .similar  behavior.  It 
should  be  noted  that  Figure  2.6  show;;  that  the  tlire.sliold  valiu's  given  =  1 
are  indepc.'iident  of  the  time  parameter  t  due  to  the  u.ic  of  tlic;  AND  I'u.sioii  rul(}. 


Probability  of  error 


Figure  2.4:  The  system  probability  of  error,  OR  fusion  rule 


■/r> 


il.eas/siiiasitaussrm 


Threshold  values 


2.4  The  Fixed  Sample  Size  Problem 


In  the  previous  section,  we  considered  the  decent ralizetl  detection  system  with 
feedback.  The  stopping  time  was  nor,  known  a  priori  and  tlir  systenx  was  optimized 
at  each  time  step.  In  this  section,  we  consider  the  case  where  the  stopping  time 
T  at  which  the  final  global  decision  is  to  be  made  is  known  a  priori.  We  refer  to 
this  problem  as  the  Fix(^d  Sample  Size  (FSS)  problem.  Next,  we  define  the  FSS 
problem  in  more  detail  and  design  the  system  so  as  to  iniuitnize  the  Bayesian  cost 
function  using  the  PBPO  solution  methodology. 

Problem  Statement  and  System  Optimization 


We  again  c.onsider  the  binary  iiypothesis  testing  problem  for  the  system  shoviru 
in  Figure  2.1.  The  .system  operation  b  the  same  as  before.  In  tlu;  FS.S  problem, 
tlie  stopping  time  t=T  i.s  known  a  priori.  Hence,  the  problem  is  to  find  tlu;  optimal 
(leci.sion  rules  7^  for  (srch  detcu’.tor  k— 0,  1,  2,  ...,  u  so  as  to  minimize  the  Baye^sian 
cost  function  ./(F),  where 


F=.{r‘;<-I.,  2,. 


(2.28) 


and  as  ixTon; 

r'-{F^.):  A 

()bserv(?  tliat  tin*  uiinimi/.atiori  is  over  tlu;  entire  set  of  decision  rules  up  to  tiuu; 
stt'p  l--'i’.  We  assume  that  tlu^  i-.oiiditional  probability  deusitj'^  fun  'lions 
7;(t/{,  !/.2, ...,  j— 0,  1  .are  known  a  priori.  In  addition,  the  proljabilities  p(//q), 

p(/7i)  and  the  costs  (,\j  :  :(:ost  {  d<!cidc  uf^  -  7/,|  hypothesis  pn^sent  -  f/jj, 
i,  j— 0,  I  are  all  assuTTuul  to  be  known  .a,  priori.  We  .a.'j.'imru:  that  the.  ubservatioiis  at 
the  (kjtector  arc  iiulcpcrulciit  in  time,  (temporal  iudependeuce).  bi  iulddition, 
the  oljst:rvation.‘i  -at  the  det<;ctor  an;  assumed  to  he  iiidiipeiuhuit  frmn  thu.se  at 
tlie  r^'''  detector,  v  /  k,  (spati.il  iiulep(!ndeucc).  Hence,  the  a  [priori  kuowiedg,;;  of 
tlie  crmditloiiii.1  (kstsity  p(?/ii  kai -m  ;!/nl  o'l)  reduces  to  ilie  a  priori  knowle'dge  of  the 


individual  detector  conditional  probability  densities  i-1,  2,  n;  j=:0,  1. 


The  Bayesian  cost  function  ./(F)  to  be  minimized  is  written  as; 

J(r)  =  Coop(4  =  0,  Ho)  +  CoxPixil  -  0,  H^) 

+F7io/’('<o  ~  T  ~  F  ^i)  (2.29) 

which  reduces  to 

■nn=--c'fpl~CHPl  +  c  (2.30) 

where  Cj,  and  C  are  as  <l<*fiued  in  S<?ction  2.2. 

We  should  observe  the  effect  of  fixing  the  total  number  of  observations  available 
in  (2.30)  where  the  probabilities  of  system  miss  and  false  alarm  are  a 

function  of  the  final  time  .stci)  t-~T.  We  would  like  to  (ind  the  set  of  deci.sion  rules 
r  sucli  that  the  Haye.sian  cost  function  J(r)  of  (2.30)  i.s  minimized.  In  Theorem 
2.3,  we  derive  the  glol)al  decision  rules  7o(.)  at  any  time  t  <  T.  The  local  deci.sion 
rules  are  derivtsl  in  'FlKXjrein  2.4. 

THEOREM  2.3 


For  the  deceiitrali'/ed  detection  .system  with  feedback  shown  in  Figure  2.1,  tlu' 
PliPO  fusion  rule  for  the  Bayesian  binary  hyi)othesIs  testing  ])roblem  with  a  fixed 
.sample  size  is  given  by 


and  for  t<3' 


n'  -- 


p(f>'VA,)  Cu 

otIu’Tiiiise 


(2.31) 


7^(/T)-u':-:  1 

(!  (ythv.vinist.. 


1 ) 


(2.32) 


31 


where  g{t,j)  =  p{u'^  =  l|u^  =  1 ,  Hj)  -  p(uj  =  1|4  =  0,  Hj) 

Proof: 

We  consider  the  cost  function  J(r)  given  in  Equation  (2.30).  We  expand  the 
probability  of  false  alarm  and  detection  around  the  local  decision  vector  U'^  at 
time  step  t=T.  Hence, 

J{T)^  CfTlurpi^ 

C,Y:urp{4=hU^m  +  C  (2.33) 

Conditioning  on  and  expanding,  we  get 

^(r)  -  Cj  Er;r  p(uj  -  H,)p{U^\Ho) 

-Cellar  Piu^  =  (2.34) 

The  global  decision  Ug  given  the  decision  vector  does  not  depened  on  the 
hypothesis  pre.'^ent;  wo  rewrite  (2.34)  as 

^(r)  =  'Epiu^  =  l\U'^)[Cfp{U^'\Ho)  -  C,p{U'^\.f.h)]  C  (2.35) 

tJT 

Since  C  is  fixed,  we  minimize  the  cost  function  J(r)  of  (2.34)  by  using  the  following 
descision  rule 

p{nl  =  l\U^')  -  1  if  I  ,,p{U^\H^)  -  <  0 

0  other  loise 

vv^hich  is  the  des.ue<i  decision  rule  7^(17^)  at  time  step  'i'  as  given  in  (2.31),  The 
global  decision  rule  7o(t/‘)  for  t<T  i.s  derived  by  expanding  the  cost  J(r)  of  (2.30) 
around  the  glo’nal  d.'jcision  «o  and  the  local  decision  vector  W.  In  this  case,  we 
have 

7K«o  ==  1.  UVh) 

■  <'d  >  P(uu  1.  ’4.  U^Vh)  +  C  (‘7-3fj) 

:jy 


.7(r) 


Conditioning  on  Uq  and  [/*  and  expanding,  we  have 


J(r)  =  =  l\v’,,U\Ho)p{ul\U\Ho)p{W\H^) 

-c,  =  lWo^U\ih)p[ul\U\  +  c  (2.37) 

The  global  decision  given  the  global  decision  does  not  depend  on  the  local 
decision  vector  17 ‘  since  Uq  is  a  function  of  t/‘.  Moreover,  the  global  decision 
Uq  given  the  local  decision  vector  does  not  depend  on  the  hypothesis  present. 
Therefore,  the  cost  function  J(r)  of  (2.37)  reduces  to 

•^(H  -  i:  i7o)p(u‘ K/‘)p((7‘|//o) 

-C.i  Zu<.U‘  P('4  =  l\ulHr)p{ul,\U')piU^\H^)  +  O  (2.38) 

Expanding  the  above  explicitly  in  terms  of  the  two  possihilities  of  the  gh  bal  deci¬ 
sion  t'ii,  we  get 

■nr)  -  >_:  =  IK  =  1,  //o)p(«^  =  i\ip)pmBo) 

U‘ 

-c,p{u^^:  IK  -  hHMK  -  i\W)p{W\ih) 

-^Csp{u^  =  IK  =  0,  7/u)p(u‘  =  0|f/‘)p(7/‘|f7o) 

-7.X4  =  UK  --  0,  /7i)p(K  =  m')pmih)  +  c  (2.39) 

Substituting  p(K  =-•  0|f/')  by  I  •  pin-Q  —  and  fa.ctoriiig  out  common  terms  in 

./(!’)  of  (2.39),  we  have 

"  (^')  \C}p{uo  ==  1  IK  =  I,  i7o)  -  CXK  I  i"-o  “  0>  lU)]p{U' ! Hi)) 

u* 

xp(K  - 

I|K  =-"  ^i)  -  P(^'o  =  l|«o  0,  fh)]pil7^\f  h) 

xp(n‘,  1|;7  ‘) 

+  Cfp(-4  l.|K  “  0,  77„)p(17Xn)  -■  aM’  ■  :  :  :  0,  11,] 

xp(l/'|/f0-|f;  (2.40) 


The  last  three  terms  are  independent  of  the  optimization  of  the  global  decision 
rule  at  time  step  t.  Therefore,  we  drop  these  terms  in  the  subsequent  analysis  and 
denote  the  new  cost  function  by  Factoring  out  the  common  term  in  (2.40), 

the  cost  function  J'(r)  is  written  as: 

•/'(r)  =  E  -  l\U%Cfp{Wm\p{ul  ---  l|u‘  =  UHo) 

w 

=  l|n‘  =  0,  ifo)]  -  C.pitmi) 

x[p(u^'  =  l|u^  =  l,//i)  -?(uj  =  l|u^  =  O.fFi)]]  (2.41.) 

Letting  p{uq  —  lluy  —  l,Hj)  -  p{uq  --  l|«o  =  0,  Hj)  —  g{t,j)  in  (2.41),  we  have 

*^^(0  -  X:p(“o  =  Mf/‘)  (C'/p(f/‘|//o)5(f,0) 

-6>(f/‘l//x),7(/,l)]  (2.42) 

To  minimize  the  cost  function  J'(r)  in  (2,42)  we  choose 

7i(no  =  J-lf/*)  —  I  if  /I  <  0 

0  otfierwiae  (^-40) 

where 

A  Cyp(r/Vio)ff(t,n)  -  t) 

With  a  little  rearrangement.  Equation  (2.43)  becomes  the  global  decision  rule 
at  any  time  step  l.<'r  a.s  given  in  Equation  (2.32)  o!'  Theorem  2,3. 

Q.E.D. 


It  .should  be  noted  that  the  above  glnb.d  decision  i  ule.s  for  t<'r  vvt>re  derived 
with  the  objectiv<^  of  optimizing  the  system  peifonnancc  at  time  i.--'!’.  On  the 
other  hand,  the  global  decision  rules  of  the  previous  section  were  derived  with 
the  objective  of  optimizing  the  .lystem  performance  at  time  t  iiul.e;pendently  of 
the  lutere  decisions,  i.t?.  the  objective  was  to  optimize  tin;  i;;:r form  nee  of  the 
(.Ujcis'on;;  ;d;  every  time  t  which  may  not  result  In  optimal  performance  lor  the 


decision  ."it  time  t=T.  Next,  we  present  the  derivations  of  the  local  decision  roles 
7^(.),  k=l,2,.  ...n. 

THEOREM  2.4 


For  the  decentralized  detection  system  with  feedback  shown  in  Figure  2.1,  the 
PDPO  local  decision  rules  fi  >-  the  Bayesian  binary  hypothesis  testing  problem  with 
a  fixed  sample  size  is  given  by 


«!■  =  jKi/LK  *)  •=  1  M’/l)  >  'lUK 

0  otherwise 

where  i;;  the  k‘'^  detector  thmshold  given  for  t=:T  as 

T,  T-l,  <''lT.UTKUl)l>[VL^'\lh) 
aiZur  nui)p(uL<-'\H,) 

fWl)  =  ?(■■?  “  AVI)  -  v(nl  =  i)\Vl) 


and  for  t<'r 


ci<jn,Q)T.vimt}vwiyo-'w 


^  /'(«o  =  1  “  U  fh)  ~  p{' 


0,  II,). 


Proof; 


(2.44) 


(2.45) 


(2.46) 


We  first  derivt;  the  local  decision  rules  .U.  t.iuie  sten  t- We  K;r,;!.Il  Rqua.tion 
(2.35)  and  write;  it  cixplicitly  iu  tonus  of  tlio  k^''  hjcal  tleicisioii 

./(r)  -  z„r  i>{<  =  I  -  f-w,(f/siff,)i 

I  T.U, :  I  WT„)icMuijiiu)  - -1^  ('  (2<'0 

wlicre 


Substit  ttinj?p(C/^|//,)  by  p{Uj^ \Hj)  ~p{U^-^\Hj),  i~0,  I  in  (2.47),  rearranf^ing  and 
factoring  out  common  terms,  we  have 

J{T)  Y1  OfPiULlHoYipin'S  -  l|r/Ji)  -  p{u'^  -  l|i/Jo)l 

-Cdp{u^i\B:i)\jp{uo  =  i|r/Ji)  “P(w2’  =  i|c^w))] 

+p(»5'  =  mDlCfPiUmo)  -  CMUn^i)]  +  C  (2.48) 

Noting  that  the  last  two  terms  in  (2.48)  are  independent  of  the  optimization  of  the 
local  detccl.or,  we  (Iron  those  terms  in  the  subsequent  equations  and  denote  the 
new  CO:  I.  function  by  ./‘(I’).  Letting  p(nQ  =  l|f'^;yi)  ~  p(^^o  ~  fi^k) 

factoring  it  out  in  Equation  (2.48),  we  get 

-  i:f{Ul')[CfpiUl\Ho)  ■-  Cdp{Ul\H,)]  (2.49) 

Expanding  Ecjuatlon  (2.49)  in  the  previous  global  decision  and 

yr  . 

{j/J ,1/2 1  •••i  Vn)  tbe  observation  vector  of  local  detectors  at  time  .step  t--T, 

~-(7jp(C^**„u;r-\r'^’|i/i)]  (2.50) 


v/hcre  the  integral  fyr  is  nudtifold  integral  of  dinien.sion  ii.  H3"  conditioning  (2.7)0) 
on  »()”■’  and  V‘,  we  have 


r;r 


iyT[t;/p(/y2il«r’,  a,)p(y'^\uY^ii/„) 
('up(fylii4  'S  (^--ii) 


It  i:;  .seen  tliat  the  local  d<;cision  vector  17^^  givcai  both  the  previous  global  decision 
■'  and  the  observation  veetor  does;  not  depend  on  the  hypothesis  presc:nt. 
A.'isuiiiing  the  ohs<;r’'ation  independence  in  time,  tlui  previous  global  deci.slon  ujj 
is  independent  of  the  ob.s«u'vation  vector  Y‘.  In  addition,  the  local  dfdt^ctoj’s 


decision  depends  on  tiie  detector’s  inptjt  and  not  on  other  detector  decisions. 
Hence, 


p{U^i\u'^  \Y'^)  ^  p(uj^  =  l\u^  \Y^)  II  p(uf|u^ 

Using  the  spatial  independence  of  observations  the  above  reduces  to 

p(«i  =  yj )  n  vD- 

Substituting  all  of  the  above  results  in  the  cost  function  J'(r)  of  Equation  (2.51), 
we  get 

=  E  .fyr[Cfp{ul  -  llu^Syn 

(n;=i../iP(wfi«(i'"‘,yn)(n?:=iP(y.-V^o))p(u5“^iHo) 

-c^pi^'k  ==  i|«o~\yD(nLi.,-^*  p(wri4~\yf)) 

(n'LtP(yfK^i))p(«o~^l-^A)]  (2.52) 

Factoring  out  the  common  term  p{u[  ~  )  ■'.tuI  rearranging  tlie  ord'f^r  of 

integration  and  summation,  we  have 


j\v)  ■-  X 


pI'sHW)  y/')p(/A- ’KA)))p(yii’Kf.])p'(ui[''^l  //o) 

P(«o“'|//i)]  (2.53) 


IiitegratiTig  over  ,  W(;  rc^writii  (2.53)  u.sing  notatioics  of  Se:ction  2.2  a.s 


-  E  .4-P(«i  -  M"E\yDEr/-/(f4) 


x[CVp(f4|«J-\/4)p(yr|/4)p(u;'r^l//n) 

-  ih)p{yk\fh)piW)  ’  '^\fh)l 


(2.54) 


1/ 


To  miniinize  the  cost  function  of  J^(r)  in  (2.54)  we  choose 


■  ■  I 


where 


p(7t,f  l|nj  \t/^)  =  1  ifAo<  Ai 

0  oiherwise 

in 


-4.  --‘i:n'n)CMuI\«l-\iiMyl\aM4-'W 

<n 

The  k^''  local  decision  rule  at  time  step  T  is  therefore  Riven  by  rewriting  (2.55)  .is: 

■'0 

.ri 


1  :fPiykUh)  ,-r.  -j-1^ 

p{yl\!h)  "  ’ 


0  othtirwif>e 


(2.5b) 


(2.57) 


where  is  the  detector  threshold  at  time  step  dehncd  by 

'n.  P-'- 1  \  ^Mp(»s''N^q) 

^77  y:nr 

as  given  in  K<iuations  (2.44)-(2.4t)).  The  local  decision  rules  for  time  step  t<T  .ire 
derived  by  recalling  Equation  (2.41).  We  write  (2.41)  e.vplicitly  in  terms  of  the  kP' 
local  decision  rule  at  time  step  t, 


ul' 


p{<  lK/^r){6Vp(f^^J//n)[7>(Kir  liu‘  -  l,//o) 

-p(4  -  iK-0,7/.,)! -a,p(r/)(j/7,)[p('‘;!’-  -  1,7/t) 

p("u'  -  Ih4  -  0,  /A)]}  i-p(nf,  =-•  \  \uiMPsv[^no\fh) 

lp(  i.l,(  .-  1|  (4  l,  7/,,)  -/;(  u,^  () , 


'^rv' A.ul*'  i/f.rv ‘*'0 


I  |,.(  _  1  Tt  \ 

I  ii..,)  ■•  I  ,  m; 


p(Wo  H'"n  'h  ^^1)]} 


(2.58) 


I.etting  p(7<f,  ^  :  •■  Ijii,)  -  pir^n  -■■■  l|wo  -—  IjT/j)  — ■  and  substituting 

we  rewrite  (2.58)  eiter  rcarraugiug  ;u: 


p{<  ■  l|f/^)[C7P(fy/j77n)//(^())  -  fAp(7/A !?/,),;(/,  1)] 


•l.U 


-  stM 


s&tSismiiasssiansBssii!;^^ 


pM  “  i|t/i,)[c,K£'!.|J'i'o)s(',o)  “  Cjp{uu\H,)s(t,  1)1 

=  WMCMUl\fl«)s{i,0)  -  CMUl\l^^)g(t,^)\  (2.59) 

The  last  term  in  the  above  equation  is  independent  of  the  optimization  of  the  kth 
local  decision  rule,  hence  we  drop  that  term  and  denote  the  new  cost  function  by 
./^(r).  Factoring  out  the  i>  ailtant  v^uauiion  term,  Equa'ion  (2.59)  is  written  as 

./^(F)  =  x:  [Cfp{UlAHo)git,  0)  -  C,piUU\rh)g{t,  1)] 

b(»0  -  p(«0  (2.60) 

Next,  we  expand  (2.60)  in  n(r*  the  previous  global  decision  and  T'  tlie  observation 
vector  of  the  local  deiector  at  time  step  t  to  get 

I’l 

-6X£/^„u^>,V'‘|//,)<;(M)] 
x[p(«o  ==  Wki)  -  p{4  ■■=  i  K^in)]  (2.61) 

betting  ;.i((i(,  l  |/^u)  -  l|f/;(„)  =  /(f/(.)  and  l■onditi<)llin;’;  on  iuid 

we  get 

‘>^'(1')  E  Eui-  fy  m'niCfPimiK  \Y\n,) 

>i(n,V  ‘,  r‘|//„)i/(/,0)  -  (;,ip(uUWn  \YY  //,) 

x/.(«f,-‘,K‘|//,)r/(M)]  (2.62) 

'I'ht'  local  (It’cisinn  vector  IJj.y  given  botli  tlie  previous  gloluil  decisinn  ‘  and 
the  observatiiin  vector  does  not  rlepeiul  on  t)i(5  hypothesis  iire.-icnt.  thiiiig  the 
observation  iudependeuce  in  time,  the  oh.serv.ation  vector  is  iiidepeii.leut  of  the 
l.ut!vions  global  decision  Therefore,  I'hpiation  (2.(i2)  is  Wi.itti'ii  a.s; 

■nn  --  E  mi)  fy[('fimMY\  >") 

xp(«'-'|//,)p(v^'l«u)/y(<,')) 

^  ‘'\fli)P{Y^lh]<jit,  1)]  (2.i;:i) 


1') 


The  local  detector  decision  depends  on  the  input  of  this  detector  and  not  on 
other  detector  de<-isionr;  and  observations.  Moreover,  using  tiie  spatial  indepen¬ 
dence  of  observations,  we  write  the  term  y*)  as 


=  p(«fc  =  i|«o  ^y*)  X  n 

Substituting  the  above  in  Equation  (2.63)  and  rearranging  the  resultant  terms,  we 
have 

0)p(v.(|//n)  nr..x.,y.it  y‘ )p(y.' K^o) 

n7.=i.i^fcP(w,-|uo'\  P,-)p(v.'!^i)]  (2-f)4) 

Taking  the  coiiininti  thrtnr  p{r'\  --  and  integrating  (2.64)  over  the 

observ-ation  vector  'uily,  we  get 

To  iiiiuiinize  tlie  cost  fnixtion  J“(r)  of  (2.6.5)  wi^  choose 

-=  l|i4~Sy):) I  i.f.%<Ai 

0  othn-iuitic  (2.66) 

where 

X:/(^4‘)[^Xf^)[,<V:^o)//(i,0)p(!/^|ffu)] 
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where  we  substituted  p{Ul\u^^^,Hj)  for  combined 

p(Ul\uQ"^,Hj)  and  p{uQ"^\Hj)  to  yield  p{Ul,Uo~^\Hj).  Therefore,  the  detector 
decision  rule  at  time  t<T  is  given  rewriting  Equation  (2.66)  as: 

p{yi\fh) 


7Myfc,«o  )  =  U.V  = 


^  MWo) '  ^ 

0  otherwise 


(2.67) 


where  //]t('“o  ')  the  detector  threshold  at  time  step  t  defined  as: 


Cf9{t,Q)T.uifm)piui4-'m 


t  /  f— 1\  j ^  \ 

^ 


as  stated  in  Theorem  2.4. 


Q.E.D. 


It  sliould  be  noticed  that  there  are  two  different  threshold  equations  for  the 
local  likelihood  ratio  test.  The  first  equation  is  (2.45)  for  time  step  t=T  and  the 
second  equation  is  (2.46)  for  time  step  t<T.  Similarly,  the  global  decision  rule  has 
a  threshold  of  Cf/C^  at  time  t=T  and  Cjg{t,0)/Cdci{t,  1)  at  time  t<T  as  stated 
in  Theorem  2.3.  The  system  thresholds  up  to  time  T  are  found  by  simultaneously 
solving  the  set  of  thre,shold  equations  given  by  (2.45)  an  1  (2.46)  for  all  time  t, 
t.<  '1'. 


System  Performance 


Next,  wc  present  the  jjerformauce  eqtiation.s  for  the  .sy.stein  namely  the  system 
prc)b;),bi}ity  of  error  pl^.  A»  before,  the  .system  probability  of  error  at  time  1.'  is 
given  by 


T'he  .sy.stein  i)rc)hability  of  false  alarai  and  miss,  i.«;.,  ,  are  givexi  by  Equations 

(2.22)  and  (2.2.5)  re.spectively.  We  n:call  those  erpiatioms 


pI  Pfo'iPfM  '  0 


-pWr'  +p'M  ^  ”) 


(2.60) 
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pU  pU^[pU(^o"''  =  0)  -  pUK  '  =  !)]  +  Pmo(«o  ^  =  1) 


(2.70) 


where 

pL(“o''  =  0  =  Ep«  =  0ILr‘)p(U'lut'  =  (2.71) 

=  0  -  Ep(«o  -  m^)p(L/%‘o~^  =--  i,Ho).  (2.72) 

r/‘ 

'J.'he  performance  of  the  system  is  found  wiien  t--T.  Hence,  the  system  probability 
of  miss  and  false  alarm  have  to  be  computed  recursively  up  to  time  step  t— T. 
Time  step  t=l  represents  a  special  case  where  the  global  decision  rule  i.s  the  same 
as  given  in  Equation  (2.32)  of  Theorem  2.3  with  t=;l.  The  local  decision  rule  is 
the  same  as  in  Equation  (2.44)  of  Tlieorem  2.4  with  the  local  threshold  equation 
of  (2.^6)  modilieil  for  t— 1  as  follows 

CMt  -1,1) Zui  ^  ^ 

which  is  obtained  by  dropping  the  previous  global  decision  term  in  Equation 
(2.46). 

It  is  .seen  that  tlireshold  equation  of  the  detector  is  coupled  with  other  (K;- 
tector  thre.sholds  at  time  .step  t,  i.e.,  we  have  spatial  coupling.  In  addition,  there  i.s 
a  temporal  coupling  of  threshc'M  equa.tiou.s  through  the  term  g(t-n,  0).  Hence,  wt; 
have  a  set  of  non  lin(;ar  threshold  (.'quatioiis  tliat  an*  coupled  spatially  and  terinpo- 
rally.  For  a  given  time  t— T,  the  computational  complexity  appears  to  inhibit  a 
numerical  solution;  henc<;,  iu  th<;  next  section  we  consider  a  .siiuphn-  system  con¬ 
sisting  of  only  one  detector  with  ftHxlback,  thereby  eliminating  the..spa,tial  coupling 
with  other  flettjctors. 


2.5  The  Single  Detector  with  Feedback 


We  consider  Ihe  single  detector  system  with  feedback  shown  in  Figure  2.8.  In 
this  sj/’stein,  we  only  have  a  .single  detector  and  do  not  have  separate  global  and 
local  detectors.  Therefore,  the  results  obtained  in  the  previous  section  cannot  be 
used  directly.  Using  the  notations  defined  earlier  and  dropping  the  subscripts  since 
there  i.s  one  detector  only,  we  derive  the  FSS  decision  rules  for  thi.s  system  next. 

THEOREM  2.5 

Fur  the  one  detector  with  feedback  shown  in  Figur*  2.8,  the  decision  rules  that 
mininiizc  tire  Bayesian  cost  function  in  tire  binary  Irypothe.sis  testing  problem  with 
a  fixed  sample  .size  i.s  given  by 


7^2/^)  =  I  if  A{2/')  >  6’/5(l,0)/(7rf//(l,  1) 

0  otheriviae 


(2.74) 


.•uul  for  t  > 


I.  if  A(i/  )  >  ~ 


Cu!j[t,l)p{n^-^\Ih) 


0  othvTitnae 


(2.75) 


wli(!ve 


Proof: 


i’  .  I  u.f 


Recall  the  Ha.yesiaii  co.st  fiiuction  to  be  ruiniini/.  d 


-  \  c 


(2.7(1) 


where  77/,  ('d  U  axe  as  defiuerl  before.  We  ex))and  and  in  terms  of  -a' 
•n'’)  ^  ^  ^  '.".'|o'u)  CdT,ifa'  .  l,u'|//,)  |.  (7. 


(2.77) 


Pig.  2.8:  The  single  detector  sy.stem  with  feedback:. 


Conditioning  on  n*  auad  expanding  (2.77),  we  get 


‘^(1’)  -  -  l\u\  H^)p{u^\H,)  +  C  (2.78) 

u‘ 

Writing  the  above  equation  explicitly  in  term  of  all  possibilitie.s  of  id,  namel}'’ 
id— -0,  1  and  suh.stituting  p(id  —  0|7/j)  =  1.  —  p(?d  ■-  l|I7j),  we  get, 

j(r)  Cfp{u^  =  i|id  -  .1,  /fo)p(td  ==  i|//o) 

+C>(n'''  =  l|td  =  0,  Ho){l  -  p(id  -  l|7fo)) 

C,ip{u^' l|ii'  -  ],Ih)pin^  - 

l|id  -  0,  fft)(l  - P(u‘  -  l|/fi))  +  C  (2.79) 

Multiplying  out,  factoring  the  common  term  p(n‘  ^  ■  l|/.r,)  out  and  rearranging,  we 
get 

./(!')  Cjp{u^  =  l|/7o)fp(«"  =  ).|'(d  -  l,//o) -p{u^  -■  l|u'  -  0,/f,)] 

-QKid  -  =■■  l|u‘  l,f/,)  p{n^  =  l|n'  = 

■  -(’jP{h^  1  |id  =  0,  Ifo)  —  (lipiv.'  -•••  I  |id  —  0,  Hx)  -1-  C  (2.80) 

d'lie  last  tlnee  ternus  are  independent  of  the  optiinization  of  the  deci.siou  rule  at 
tinu;  t.  Ileuct;,  w('  drop  theae  tcrnin  and  diaiote  the  new  cost  function  by  ./'(!’). 
I, lotting  p{-u^  -  l|id  ■—  1 ,  U j)  —  p(u^  -  l|id  --  0,  Hj)  ;  ;  we  rewrite  I’bjuation 

(2.80)  as 

./‘(I')  r.Vp(ld  l|ff„).l,(C0)  -  (X<d  :  I  |  7fO.V(^  0  (2.81) 

Introfiucing  tin;  observations  and  using  tlu;  la.w  of  total  probability,  we  liave 

J‘(r)  f  Cfp{t,(])p{n^  -  1,?/U^)  l  )p(«'  Cj/'M^i)  (2.82) 

Jyt 

Conditioning  on  ami  expanding  the  above  we  get 

./'(F) 


('df/ii,  l  )7'(«‘  ■  "  ■b/‘i  ^^i)f(7/‘U'/i) 


Letting  t— 1  in  the  above  equation  and  observing  that  the  detector  decision  u* 
given  the  observation  does  not  depend  on  the  hypothesis  present,  we  factor  out 
the  resulting  common  term  and  rewrite  Equation  (2.811)  as 

ji(r)  =  /  •=  =  i,o)p(2,'iLfo)  -  =  i,i)p(yN^i)]  (2.84) 

To  minimize  the  cost  function  J'‘(r)  of  Equation  (2.84)  we  choose 


p(i4^  l|y^)  =  I  if  C fg{t  ^  l,0)p{y^\Ho)  < 

Cdgit  =  l,l)p(yV^i) 

0  otherwise. 


(2.85) 


which  is  the  decision  rule  at  time  t=l  as  given  in  Equation  (2,74  )  of  Theorem 
2.5.  We  proceed  to  derive  the  rest  of  decision  rules  for  t>l  by  expanding  Equation 
(2.82)  in  terms  of  the  previous  detector  decision  as  follows: 

./'(F)  =  /  C/p(u‘  -  l,u^-\y^\Ho)<,{t,Q) 

Jyt 

Crfp((i‘  ^  l,u‘"Sj/‘|//i)r/(i,  1)  (2.8t)j 

Conditioning  on  and  and  expanding,  we  have 

-GX-cd  -  ■(lid“\y‘,//a)p(u'-\,v‘|/^i)5(G1)  (2-871 

The  decLiou  uf  given  the  observation  and  the  previous  decision  does  not 
depend  on  the  hypothesis  present.  Therefore,  we  rewrite  (2.87),  after  factoring  the 
common  teimp(u*  \  out,  as 

J^(r] ---  /  y"  p(u‘ ~  li^d~^yy^Gy'7(*-,0)p(^/^'^d '‘j/Zo) 

•G‘ 

•G’,ip(i,  ])p(?/L7r‘“*|/7i)]  (2.88) 

To  minimize  the  co.st  function  J^(r)  of  (2.88)  we  choo.se 

p(7d  1  \u‘  \y*)  -  1  if  0)p{y\  ^|J/o)  d 

X<Gnp(.ld,u'"^*|Z7i) 

0  othervnsv..  (2,8;)) 
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as  stated  in  Equation  (2.89). 


q.E.u. 


At  time  t~T,  we  have  g(t— T,  j)  =  1.  This  results  in  the  decisiua  rule  at  time 
t=T  defined  a  : 


7  {y  . «  “  )  1  if  A(y  )  > 

0  otherwise 


(2.90) 


The  probability  of  error  for  this  system  is  given  by  Equation  (2.68)  with  the  prob¬ 
ability  of  miss  and  false  alarm  as  given  by  (2.69)  and  (2.70).  However 


P‘.(U‘-W-=Z):=: 

i  <.A.» 

/  dFi 

(2.91) 

p'  (td-^  =  f)  - 

fCO 

/  dFo 

(2.92) 

where  /  )  and  Fq  are  the  conditional  probability  distributions  under  tlie  liypotlie.se.s 
Hi  au  I  Ho  respectively.  The  quantity  =  i)  is  the  tlireshold  to  be  used  when 

integrating  over  the  probability  densities.  It  is  related  to  the  threshold  r/‘(ii‘“^  =  i) 
in  an  obvious  manner, 


In  the  next  section,  v/e  apply  the  results  obtained  in  this  section  to  fscrial 
networks. 


I 


a 


. 


tion  RtJHuits  for  tho  Seriai  Not, work 


In  this  st;ction,  we  pre,serit  the  design  and  analysis  of  another  important  cla.s:;  of 
dccentralii!;od  detection  networks  namely  the  .serial  (tandem)  network.  This  class  of 
networks  lias  been  invcstigatc?d  in  the  literature  [8,  17,  Ilj.  We  show  tlie  .similarities 
of  the  .serial  network  with,  the  decentralized  detection  system  witli  feetlback  sl.ndied 
prcviou.sly. 


4/ 


Consider  a  serial  system  consisting  of  N  detectors  shown  in  Figure  2.9.  Based 
on  its  obuei  vatic  ,  the  first  detector  maJces  a  decision  regarding  tlie  hypothesis 
present  and  transmits  it  to  the  second  detector.  The  second  detector  bases  its 
decision  on  the  decision  of  the  first  detector  and  its  own  observation.  This  deci¬ 
sion  ia  transmitted  to  the  third  detector.  This  process  continues  until  the  final 
detector  which  yields  the  global  decision.  This  serial  .S3'^3tem  can  oe  viewed  as  a 
single  detector  system  with  feedl  '.ck  discussed  in  Section  2.5  with  t=n.  Thus,  the 
threshold  equations  for  the  serial  .system  can  be  written  by  substituting  t~u  aud 
T=N  in  Equations  (2.74)  and  (2.75)  of  Theorem  2.5.  The  results  are  presented  in 
Lemma  2.1  next. 

Lermna  2.1 

For  a  serial  sy.stem  con-si.sting  of  N  detectors  as  shown  in  Figure  2.9,  the 
detector  decision  rule  that  uiinirniises  the  Bayesian  cost  function  in  the  binary 
hypothenia  testing  problem  is  given  by: 


7'(y‘)-w‘=  1  i/A(y’)>~^ 


bV//(l,0) 


0  otherwise. 


(2.92) 


and  for  n  1 


7'‘(y",u'*-')-n" 


■'  ^  "  f;,.</(n,l)/>(n->|//i) 

0  othcrii)i.';r. 


(2.94) 


where 


Proof: 


.</(n,.7)  =  p{u^  -  l|ti"  I,  Hj)  -  p{u^  l|n’‘  9,  // ■) 


A  direfl  suhatitutioii  of  t-  I  and  'I'— N  in  Equations  (2.92)  and  (2.94)  rtoults 
in  liquations  (2.74)  and  (2.75). 

U.E.D. 


Fig.  2.9:  A  serial  system  consisting  of  N  detector 


In  order  to  demonstrate  the  validity  of  our  results,  we  consider  the  case  nf  3 
detectors  in  tandem  and  show  that  our  results  agree  with  the  results  established 
in  the  literature  [8].  For  N~3,  the  decision  rule  of  the  first  detector  is  given  by: 


7'(s/^)  =  =  1  if  Ml/)  >  rf 

0  otherwise 

where  7;^  is  the  threshold  of  the  first  detector  defined  as: 


(^[^(74'^  ~  -  F  ^^0)  ~  ^q)] 

ChIpM"'  -  -  1,//,)  -p(ua  ^  i|ui  =  0; //,)]■ 

'rhe  decision  nde  of  tlie  second  detector  is  given  by: 

/(y'\  -u~  =  1  if  My^)  > 

0  otherwise 

where  is  tlie  threshold  of  the  second  det("ct.or  deruu;d  as: 

l|u'^  =.'T,  n/%p{u^\H,)' 

'I’lie  decision  nde  of  the  third  det»;c.tor  is: 

/iy'\/)  =  /  ^  1  if  Ml/)  >  >/(/) 

0  otherwise. 


(2.95) 


(2.9(7) 


(2.97) 


(2,98) 


when;  ?i'\Tr)  i.s 


as: 


It  is  sesni  thiit  tliese  decision  rules  are  the  same  as  tho.se  of  l{eil)nv;m  and  Nnltf; 
[8|.  Auidogou.sly,  solving  the  single  detector  with  feedhixek  problem  up  v.o  time 
correspond;;  to  solving  the  j)roi)lem  of  N  detectors  in  ta7e](:m.  Moreover,  tin; 
decison  rnle  ;it,  time  step  t  <  'V  in  tin;  single  dete.-.tor  with  feed’oack  corresp(7iul;i 
to  the  deci.siou  rnle  of  the  detector  {n  <  N)  in  tin;  tandi'ui.  network. 


■iO 


Having  established  the  correspondence  between  the  serial  network  and  the  sin¬ 
gle  detector  with  feedback,  the  riat  of  our  work  on  decentraliiied  detection  systems 
with  feedback  could  be  applied  to  more  complicated  configurations  such  as  the  one 
shown  in  Figure  2.10.  In  this  system  configuration,  the  block  of  n  detectors  and  a 
fusion  center  is  repeated  T  times  with  the  decision  of  each  block  feeding  into  the 
next  block.  The  decision  rule.s  for  this  tandem  configuration  are  given  by  the  deci¬ 
sion  rules  for  the  decentralized  detection  system  with  feedback  given  in  Theorems 
2.3  and  2.4  with  time  step  t  corresponding  to  the  block  in  the  tandem  network. 
Hence,  the  tandem  configuration  of  Figure  '2.10  is  erjuivalent  to  the  decentralized 
detection  system  with  fcs'^dback  with  the  block  thresliolds  of  the  tandem  net¬ 
work  being  the  same  as  the  time  step  thresholds  of  the  decentralized  detection 
system  witli  feetlback.  [f  tlie  decision  rules  obtained  in  Section  2.3  are  used  for  the 
system  shown  in  Figure  2.10,  then  the  interpretation  is  that  each  detector  block 
of  the  tandem  network  attempts  to  optimize  itself  rather  than  trying  to  optimize 
the  entire  system. 


2.7  Discussion 


In  this  chapter,  we  pre.scnted  the  Bayesian  formulation  of  a  decentralized  tletection 
system  with  feedback.  'Two  cases  were  considered  iiamelj/  the  FSS  problem  and  the 
less  restrictivir  problem  of  the  .system  without  any  a  priori  knowledge  of  the  .stop¬ 
ping  time.  Local  detector  threshold;;  were  .slunvii  to  be  a  function  of  the,  prcviou.s 
global  <le<:3sion.  It  w.as  sliown  tliat  a  serial  detection  sysleiii  can  be  intorpreterl  ;is 
a  single  detector  system  with  hxidback.  Numerical  r<:;sult.s  for  sy.stein  performance 
for  the  case  ;)f  uuknowii  stopping  time  were  obtained.  Numerical  result.s  showed 
that,  a  performance  a.dva.ntage  of  the  decentralized  dt^tectiou  .sy.stem  with  feedback 
considered  in  thi.s  chapt<'r  over  the  cx)i;r«:spouding  decentralized  detection  system 
without  feedback  csnuujt  b(3  est.'iblished,  in  genr;r;d.  lu  tin;  next  cliapter,  therefore. 


we  enhance  the  system  and  incorporate  memory  into  the  decentralized  detection 
system  vv^ith  feedback.  We  prove  ajialytically  that  the  system  with  memory  out- 
perforrnes  the  decentralized  detection  system  without  feedback  investigated  in  the 
literature. 


Chapter  3 


Decentralized  Detection  Systems 
with  Feedback  and  Memory 

3.1  Introduction 

111  tlu:  prtivious  chapter,  w«!  liave  conshlered  the  decentralized  detection  s5''steni  with 
feedback  shown  in  higuro  2.1.  In  that  sy.steiu,  at  any  time  t  i^ach  local  deteettor 
op<n'ate(l  only  on  its  current  observation  and  the  prewions  global  decision  .  In 
othe  r  words,  at  tiiiu;  si.ep  t,  all  previou.s  observations  yl,yi,  ■ .  ■  ,  y^  '  were  discardisl. 
Ill  this  chapter,  we  gniKTalize  tlie  system  of  Fignri!  2J.  to  inehnl  the  previous 
observations  in  the  processing  at  the  local  didecors  as  shown  in  Figure  11. 1,  i.e., 
wo  incorporate  iiioiiiory  at  tlu;  local  detectors  in  tlie  decentr.alized  dt;tection  system 
with  feedback.  We  show  that  this  .system  witJi  memory  and  feedback  outperforms 
the  conventional  decentralizcfl  d«!tection  system  without  feedback  shown  in  Figure 
.'{.2. 


lu  Section  '5.2, 


v/e  considec  the  generidizatioii  of  the  dtssaitralized  detection  sys- 


.‘id 


Fig.  3. 1:  A  dcccnualized  detection  system  with  feedback  and  memory. 


Fig.  3.2:  A  dccenrralized  detection  system  witli  t  samples  per  detector. 


tern  with  feedback  of  Chapter  2  by  incorporating  memory  at  tlie  local  detectors. 
The  local  detector  operates  on  tlie  previous  global  decision,  its  current  observation 
y],  and  all  previous  observations  . . .  ,37^  ’  to  produce  the  local  decision  u\  as 

shown  in  Figure  .‘1.1.  We  formulate  the  Bayesian  hypothesis  testing  problem  for 
this  system.  Using  the  FflPO  solution  methodf)Iogy,  we  derive  the  optimal  fusion 
rule  and  local  decision  rules.  I'he  system  perforniauce  is  evaluated  and  compared 
to  the  performance  of  a  dccentralizeti  detection  .system  without  feedback  shown 
in  Figure  .'1.2.  The  asymptotic  performance  of  the  decentralized  detection  system 
with  feedback  is  investigated  and  the  probability  of  system  error  is  shown  to  go  to 
zero  asyniptoticall5'.  In  .Sei:tion  ;l.3,  we  study  the  data  transmission  requirements 
for  the  system  where  due  to  the  feedback  links  additional  data  transmission  i.s  re- 
(luired.  Techniques  are  developed  such  that  the  data  transmission  reejnirements  are 
reduced.  We  propose  .and  study  two  protocols.  Numerical  exainpl»?s  are  pre.sented 
in  each  section. 


,1.2  System  Description  and  Problem  Statement 


la  this  section,  we  considi'r  the  liinary  hypothesis  t(!sting  prclilmn  for  tiie  system 
shown  in  Figure  il.l.  'I'his  .system  <’oiisists  of  n  local  detector:;  which  enummnicati! 
tluur  de.ci.sIoDS  to  th<;  fu.sion  c(!nt<'r.  'The  fusion  center  ccunmuincat.e.s  the*  global  de  ¬ 
cision  l)ack  to  (S'lch  oFtlie  ii  detectors.  'The  sy.stem  opeuatiou  is  de:icribed  .ci  follows: 
At  time  step  t,  the  detector  makes  the  loc.d  decision  i/J.,  k~  1 ,  2,  ...,  u,  liased 

on  tlie  previous  global  decision  uf|  '\  the  pceviuics  o’eserwitiaiiK  .7^.  A  '.  •  •  •  .  ,'4 
de.noted  liy  i'J-i.Jt  tlu:  current  oh.s«irv;ition  i/{..  Tlie  loc.al  decision  ii[.  i.s  trans¬ 
mitted  to  the  fusion  center  wh,i!r<i  it  i.s  <-ouibined  with  the  otlu'r  incoming  loc.a.l 
decisions  to  yield  the  global  decision  uf,.  'I'be  global  decision  »(,  i.s  fed  Inick  to  all 


tile  local  dete.ctor.s  foi'  ii.se  at  the  .next  time  step  t-f  1.  We  a.ssum«i  that  tlie  joint 
t-onditicund  probability  (iensity  fimetiouM F*  T^|./^;),  j  eO,  L  are  known 


■i/ 


a  priori  where  y‘  is  the  concatenation  of  all  local  observations  at  time  step  t,  i.e. 
yt  _  The  local  decision  uj.  is  obtained  using  the  decision  rule 

7^(.)  as  follows 

where  Yt,k  ~  i  f/fc}- 

The  global  decision  is  obtained  using  the  global  decision  rule  7o(.)  as  follows: 

Ho-7o(C/') 

where  [/'  {n‘ ,  u.^, . . . ,  n',}. 

Tlic  problem  is  to  find  the  TOPO  decisum  rules  -/[.(.)  for  each  detector 
k— 0,  1,  n,  so  as  to  minimize  a  given  cost  function  7(1').  For  the  Bayesian 
formulation,  the  cost  function  ./{!')  is  given  by, 

,/(r)  -  Cmp{<  =  0,  //.,)  -f-  r;oip(/4  -  Qjh) 

\  -  1 ,  /7„)  +  fAaKuf,  -  i ,  /7i)  (T  i ) 

where  Cm-,-,  i,  j-T,  L,  is  the  cost  of  <leciding  -  Hi  wheii  the  true  hypotliesis  is 
//,.  'I'he  costs  i,  j-0,  I  and  the  a  priori  probabilities  p{Ho)  and  p(7fi)  are 
assiuued  to  l>e  known.  Rewriting  (3.1)  in  term.s  of  the  probability  of  false  alarm 
;i,t  time  step  t,  and  tin:  probability  of  di'tection  at  time  step  t,  p^^^,  we>.  liave 

■'(!')  -(,>4,  (M) 

wlun'e 

Cj  ^  /’(77o)(7m)  -^m) 
c;,, . .  P{n,){an-Hn] 
a /^( //„)(■',«,  -!-  r{n\)Cui 

l.n  tlie  lUixt  section,  we  derive  the  decision  rule;)  7|;(.)  b-'r  k-'-O,  I.,  ...,  n,  and 
cvii.luate  l.iie  system  performaac:;. 


');i 


3.3  System  Optimisation  and  Perfox  mance 


Before  we  proceed  with  the  system  optimization,  we  make  certain  simplifying  as¬ 
sumptions.  VVe  assume  spatial  independence,  i.e.,  the  observations  at  the  k*'' 
detector  denoted  by  —  {yi,yjr^i  •‘•lyl}  statistically  independent  of  the 
observations  at  the  detector  (jy^k).  Therefore,  the  a  priori  knowledge,  of  the 
conditional  probability  density  functions  j~0,  1,  reduces  to 

the  a  priori  kncnvledge  of  the  individual  detector  conditional  probability  densities 
p(7/J,, k=l,  2,  ...,  n;  j=0,  1.  In  addition,  we  assume  that  the  ob¬ 
servations  at  the  detector,  l/k^ylT^ ^  ■■■■>yk  independent  in  time.  Thus,  the 

a  priori  knowledge;  of  the  individual  detector  conditional  probability  density  re¬ 
duces  furth<;r  to  the  knowledge  of  the  eoiulitional  pi'obability  densities  piyi\Hj), 
k-1,  2,  u;  j=0,l;  t--!,  2,...  . 

Next,  wo  proceed  with  the  minirnizatioti  of  the  cost  function  given  in  Kcpiation 
(2.2).  Using  the  PBFO  design  methodology,  the  optimal  fusion  nile  7(‘(.)  that, 
miuiuii  '!i  the  eo.st  function  is  flerivcd.  The  result  is  pres('ut(;(l  in  Tlujorem  d.l. 
Assuming  tlie  knowledge  of  the  fusion  rule,  the  local  decision  rules  7[.(.),  k--),  2, 

n,  that  unuimizr;  the  cost  function  of  Kcpiation  (3.2)  arc  derived  in  'I'heorem 
3.2. 


THEOREM  3.x 


For  the  decentralized  detection  .system  with  fe(!dl)a.c,k  of  Fitrtu-e  3.1,  the  f^HFO 
fusion  rule  for  th<;  l.layesian  binary  hypothesis  testing  i)roh]t'm  is  giv(;n  by 


-  nf, 


1 


if  A(N‘)  7 

otharwi.Hv. 


0,i 


(3.3) 


0 


where 


Proof: 


:  the  lihdihood  raito. 


Suiee  the  fusicii!  center  operation  is  iJeutical  to  that  of  the  systen.-  considered 
in  Ch.o.pter  2,  th.;  rt;su)t  arid  the  proijf  are  idefiiica!  to  those  in  Tlieorenj  2.1  cf 
(lhnpi.ec  2. 

Q.E.D. 


THEOREM  3,2 


The  PBPO  decision  rule  at  tlic  k"''  detector  for  the  Bayesian  biuary  hypothe-sis 
te.stirif5  problem  is  given  by 


-  ui  -  1.  if  A(Ka)  > 

0  othtrinise. 

where  is  the  threshold  of  the  detector  at  time  .step  t  defined  as: 


(d.'i) 


CrEr;‘/(f/np(f/^,«o  M//i) 


and 


Proof: 


Rf'call  iMpiation  (2.1)  of  rhcoreni  2.1 


O 


)(6Vp(f/‘|Ru)-cxr/'|//i)]  +  f;. 


f/< 


We  write  (d.G)  explicitly  in  terms  of  the  local  di'cision 

-  E  pi<  - 

^\’W){('iPi(n.U%)  C,r’{(n,\nn)\  I  c 


(3.6) 


(d-V) 


(A) 


where 


^ki  ~  **2)  •••>  '^k  h  •••!  ^n}' 

Substituting  p(f/fco|Hj)  ==  p{Ul.[Hj)  -p{UU\Hj),  j^^O,  1,  in  (3.7)  and  factoring  out 
common  terms,  vve  iiave 

J(r‘)  ^  LV-  p(4  -  mi-i)lCjp(i^^,ji^o)  -  CMf/Llffi)] 

-P{<  --  mL)[CfP{UU\Ho)  -  C,p{Ul,\Ih)] 

!  p(u'  :  i\ui^)[Cjp{ui\ifa)  -  CMmUh)]  4-  c 

Rearranging  terms, 

^(r‘)  - 1:  M  -  m^)-p«  - 

fPi 

x[Cjp{in,\no)--c,p[ui,\ii,)] 

-  l\Ul,){CMUl\Ho)  -  CMUim]  +  C  (3.8) 

It  .sjiould  be  noticed  tln,t  the  proof  up  to  this  stage  is  the  same  a.s  the  proof  of 
'rheor;;m  2.1  .siace  the  development  is  independent  of  the  o’oservation  variable. 
Proceeding  with  the  proof,  w<;  observe  that  the  last  two  tei’rns  of  (if. 3)  nxc-  not 
involved  in  the  optimization  of  the  /d*  local  detector.  Wc  discard  tlieso  terms  in 
tlie  subs(;quent  equations  and  denote  the  now  cost  function  l)y  ./’  (P*).  Next,  we 
expand  (3.8)  in  Uq~^  the  previous  global  decision,  and  Yt  ~  {V V }  the 
observation  vectors  of  lo>:al  detectors  up  to  time  step  t,  hence 

■/'(r‘)  -  'C  [p(n‘  =  1  K/'j  -  p(i4  -  i|i7;,,)] 

(3.9) 

where  fy^  i;;  a  multifold  integral  over  all  yl  for  all  k  and  all  time  steps  up  to  and 
including  t. 

l.ettirig  p(7/‘  Ijf/y'  J  p(af,  :  ;  ■  -  lyi)  ^J-'id  e.xfjanuling  (3.S)j  by  conditiouing 
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on  «o  ^  and  Yi,  we  have 


=  5:  f{Ul)  JV.  fto) 

p{u‘r\Y\iio)  -  cMuitH-\  yuh)]  (3.10) 

The  local  decision  vec.tor  Uh  given  both  the  previous  global  decision  Uq ajid  the 
observation  vector  Yt  does  not  depend  on  the  hypothesis  present.  In  addition, 
expanding  Yi\IIj)  by  conditioning  on  V),  we  have 

[Cfv{rfLK-\ \t)pK-'\Y,  i^o)p{y\  Yt-^no) 
-cMmr\<~\yt)pi<^\yuih)p[Y\Y.^^^^^^  (th) 

where  we  liave  used  the  fact  that  Yt  — 

Due  to  the  temporal  independence  of  the  <jbservation.s,  the  prcvio\is  globa.l  decision 
Uq“^  does  not  depend  on  the  observation  vector  T*.  Furthermore,  using  the  spatial 
independence  of  observations,  we  rewrite  Kquation  (3. 1 1 )  in  ttuins  of  tln^  individual 
detector’s  otiservation  vector 

[Cjp{Ul,K-\Yt)p{icl^\Yt^r,  flo)  lYUPiytAl^o) 
-(Aip{inA<'\  E)p(n‘-^|r,  .1,  n\)  iDLi  p(n.K^i)]  (3-i  a) 

Since  the  decision  of  the  detector  depends  only  on  its  input  observation  and 
do(;s  not  depend  on  other  dt;t<;ctor  decisioins, 

l.’’urtherinore,  due  t(j  .spatial  independence  of  olrsfTvation.s,  tiie  above  i.s  written  as: 

p{ui^YY^  \Yt)  -piui  -  fj  p(-(4i4  ',y(,i) 

t'r  ;l,iy:A' 


Substituting  this  result  in  (3.12),  factoring  out  the  local  decision  term  and 
rearranging,  we  have 


./’(n  =  E 


K 


jy,,.  Cy,..*, 

n,".,,/,p('<iWr',v,,)l  (3.13) 


Combining  the  multiplicative  terms  in  (3.13)  and  unci.nditioning  on  Kf,,,  we  have 

J'(l-)  -  E  E.;-J(f4);y,.p(4  =  IhC'.Vu) 

p; 

Jy.,.  .fy,,.„  ■/y,,.[‘'>l>‘!.-'IHo)p(5'ul^W 

'’^0)1  - CM<  'Iff.) 

p(n*iff.)n?„,«p(v',,-,«!Wr‘.  ff.)j  (.i.m) 

lntej'.''atiug  over  V't,!,  ...,  Vf,A;..i,  ...,  and  uneonditioniiig  on  14“^  we 

rewrite  (3.14)  as 

-  E  /k.*k4  -  n<\yuk)'Euif[ui) 

»o-' 

(3.1!)) 

To  juinimize  the  rr^.-t  fun-etion  given  in  (o.lo),  we  choose 

p{ul  1|t4  yt.h)  =■  1  if  /h)  <  /'i 

0  otherwise  (3.16) 

wlitM/e 

-  >:.m^/)6>(yaU7,)  fi  p(u;,Hf,  ’i/^i) 


Ao=^T,m)CjpiY,,k\H,)  n  PK‘,«n^^o) 


>=1,1,^^ 


The  rlctf^rior  dcciaion  ruk'  therofo";;  is  given  by  rewriting  (3.16)  as; 

iUy,j.- <-')  =  “i  =  1  if  >  ''iW') 

0  otherwise 

wher.:  7}|,(uo~')  is  tire  threshold  of  the  k*'*  detector  at  time  step  t  defined  as; 

riYluimMVK'm 

as  stated  in  Equation  (3.5)  of  Theorem  3.1. 


(3.17) 


Q.FuD. 


It  is  important  to  observe  that  the  local  decision  rule  is  still  a  likelihood  ratio 
test.  Tiuu:  step  t— 1  represents  the  ca.se  without  feedback.  At  this  step,  the  fusion 
rule  has  the  same  form  as  given  in  Theorem  3.1.  However,  the  local  deci.sion  rule 
is  a  likelihood  ratio  te.st  given  l)y  Ukpiation  (2.18)  and  the  threshold  of  tiie  test  is 
giv<',n  by  Equation  (2.19).  For  time  steps  t  >  1,  the  threshold  //'(uq”*)  of  the 
d(!toctor  is  a  function  of  the  previous  global  decision  as  .shown  in  Equation 
(3.17).  .Since  tlie  previou.s  global  decision  .io~^  takes  twe  values  in  the  case  of  binary 
hypni',hcsis  testing  problem,  two  thresholds  exist  for  the  likelihood  ratio  test  at  the 
local  detector.s. 


System  Performance 

The  .system  performance  will  agaiu  be  ;  iven  in  terms  of  the  system  probability 
of  erorr  p‘^.  The  derivatioas  are  the  same  as  in  Chapter  2  and,  tlierefore,  we  only 
list  the  results  here,  l.’he  system  probability  of  error  i.s  given  by 

Pro  ~  PmoPi^^y  )  ('*•  ‘ 


where  and  are  the  probability  of  system  miss  and  false  alarm  respectively 
and  are  given  by 


pIno  =  =  0)  -  pU<~"  =  1))  +  pU<~"  (3-19) 


P/u  =  Ph  =  1)  -  PaK  =  9))  +  pU^o  -■"  9). 


(3.20) 


At  time  step  t=l,  the  system  probability  of  error  equation  is  the  same  as  Equation 
(2.27)  of  Chapter  2. 


Next,  we  compare  the  ijerformauce  of  the  PHPO  decentralized  detection  system 
with  fc-edback  considered  here  to  the  conventional  PBPO  decentralized  detection 
system  without  feedback  .shown  in  Figure  3.2.  Intuitively,  we  expect  the  .system 
with  feedlu'.ck  to  perform  better  because  of  the  additional  information  available  at 
the  local  detectors  due  to  feedback.  Let  the  two  systems  sliown  in  Figures  3.1  and 
3,2  be  denoted  by  system  A  and  .system  13  respectively,  'fhe  performance  of  system 
A  at  time  t  can  be  compared  witli  the  performance  of  .sy.stem  B  in  a  meaningful 
manner  if  system  B  [)roce.s.sc.s  t  observations  at  each  local  detector  so  that  tin: 
total  number  of  ob.servatious  processed  by  system  B  is  also  t  x  n.  For  the  .sake  of 
clarity,  we  only  consider  tlw^  (;ase  where  all  the  local  det<x:tor  thresholds  are  equal 
t(3  (?ach  oth(!r,  Tlie  general  problem  of  rionidentical  thresholds  may  b(!  con.sidered 
in  a  .similar  maimer.  The  result  is  presentiKl  next. 

THEOREM  3  3 


Consider  the  PBPO  decentralized  detection  systems  A  and  B  shown  in  Figures 
3.1  and  3.2  respt:ctivt;ly.  'Phe  probability  of  t;rror  attained  by  syst<!in  A  ;>t  time  t 
is  equal  to  or  less  thiin  that  attained  by  system  B,  i.e., 

(Pcq)'^'  —  (Pc)'fb 


under  the  roadition 


Pa'  <  !/2 

where  is  the  probability  of  false  alarm  of  system  A  at  time  t-1. 

Proof: 

First,  we  establish  that  for  a  spedfir.  non-optimal  choice  of  thresholds  at  the 
local  detectors  in  system  A,  the  probability  of  error  is  the  same  as  that  of  system 
B.  It  will  then  follow  that  with  an  optimal  choice  of  local  thresholds,  system  A 
will  perform  at  least  as  well  as  system  B.  We  consider  the  probability  of  miss  and 
false  alarm  for  system  A  given  by  Equations  (3.1!))  and  (3.20)  and  rewrite  them  in 


a  .slightly  dilferent  fonn  as: 

Pmo  -■=  PvjK''  ==  1)(1  -  Pm/)  (3.-21) 

P/o  ==  P/n  0‘o~^  =  l)P/r‘  +  P/„«  ^  =  0)(1  -  p};').  (3  12) 

liecalling  Equations  (2.24)  and  (2.26), 

Pm„(^hr '  =  0  =  Ep('4  -  0lf/^)p(f/'|u;r’  -  f,  //i)  (3.23) 

;4(ufr‘  -  0  -  Ep(«o  -  lK/')p(/7‘|u'-‘  -  /,  f/o).  (3.2^) 

f/‘ 

It  is  se<in  that  thert:  are  two  values  for  p*„g(«o'*  =  r)  and  p‘^^(u^  '’-  =  i)  corre- 
spfjudjug  to  ir  O,!.  Also,  recall  that  tliere  axe  i.wo  tin csliohls  ;it.  ea.ch  of  the  local 
di'teetxxr.j  in  .systx:m  A  . 


Let  7/jj  denott;  tlu;  optimal  value  of  the  local  threshold  (  singh;  thre.shold)  for 
system  B.  We  lf;t  tlie  local  thresliohl  («()"  '  --  1)  at  c;ac;h  of  the  detexdor.s  in 
:3ystci.u  A  take  a  va.hie  less  t  han  .Sinx:e  the  loxtal  dirtector  th)'e.shohls  have  been 


fif) 


assumed  to  be  identical,  each  threshold  value  at  a  local  detector  corresponds  to  a 
specific  value  of  the  system  prohaljility  of  miss  and  false  alarm.  We  let 


-7  (3.25) 

4(“o”‘“‘)  =  “-  (3-26) 

We  choose  =  0)  (>  =  1))  a*"'  some  value  such  that  the  following 

hold: 

■0)7.7.|.A  {^.27} 

/4(«o“‘  =0)-«  -  A  (3.28) 

where  A  is  any  value  such  that  the  threshold  —  f*)  satisfies  both  Equations 

(3.27)  and  (3.28).  Substituting  the  re, suits  of  (3.25)  and  (3.27)  in  l'")qna.tion  (3.21), 
tire  proliability  of  miss  for  system  A  is  given  by 

pLo  ^  (T  +  '^)plno  •1-7(1-  Arno* ) 

^  IPmc  +  ^PI^o  +  7(1  -  pUo) 

pI,  =7  +  Apf,;h  (3.20) 

Similarly,  the  re.sults  of  (3,26)  and  (3.28)  aio  substituted  in  Ifquath.ni  (3.22)  to 
obtain  the  probability  of  false  alarm  for  .sy.stem  A  as  follows: 

A/o  ^  ^P'h  A)(l  -p);;') 

a-A(]-p}"’).  (3.30) 

'Therefore,  the  system  probabi  ty  of  error  for  sy.stem  A  can.  be  written  as: 

{iQa  (7  -i-  Ap4')p(7ii)  +  (or  -  A(:!.  -  p};'))p(7/n). 


Ifxpaudjng  tlie  tenus  and  rearranging, 

(4)/i-  -nK/.'.)  i-'-K".!)- A({i  p%')v('r«) 


Next,  we  cjdculate  the  probability  of  error  for  system  B.  It  is  seen  that  the  proba¬ 
bility  of  miss  and  false  alarm  for  system  B  can  be  written  in  terms  of  7  and  o;  as 
follows: 

Pf  =  a  —  aA 
Pm --y  +  bA 

where  a  and  b  are  some  real  numbers  such  that  0  <  /)  <  n  <  1.  Without  loSvS  of 
goiu;rality,  we  .assume  that 

a  -{■  b  <  [. 

If  n  +  6  >  1,  then  we  can  redefine  a,  7,  a  and  b  with  respect  to  the  threshold 
0)  (as  opposed  to  the  threshold  =  ])).  This  will  ensure  that  the 

assumption  a  +  6  <  1  is  satisfied.  The  probability  of  error  for  system  B  can  now 
he  expressf’d  :is 

{Pr)f}  -  -  aA)p{ffo)  +  (7  +  bA)p{Hr) 

=  ap(//„)  f  tpifh)  ~  A[ap{U^,)  -  bp{l{i)].  (:j.;i2) 

From  I'Ain.atioiis  and  ('.1.32),  we  observe  tliat  for  A  =  0,  the  prob.ability  of 

error  Cor  systtUT).  A  is  the  same  that  of  system  D,  i.e., 

{pIJa  {pl)n- 

In  addltiim,  local  tluesholds  foi  l)oth  Hyst<‘uis  are  tlie  same,  i.e., 

In  other  words,  the  ilecoutialized  dj;tectiou  .sy.steiii  witli  ft:edbaek  and  meiiujry 
reduces  to  the  conventicuial  decf'ntralized  deteetioTi  .system  H  when  a  .sub  optimal 
choice  of  local  thresholds  for  system  A  is  r.iatle  as  described  a,bove. 

Next  we  c'  'iHich^r  the  ea.s(;  A  0  ;uid  show  that  system  A  performs  better  tium 
aystem  1-5  v/iien  i  /'/.  We  observe  that  the  first  two  terms  of  ai-e  i.Jn; 


fiH 


same  aa  the  first  two  terms  iu  (3.31).  It  remains  to  be  shown  that  {ap(HQ)-bp{Hi)) 
of  (3.32)  is  less  than  [(1  —  p^"*)p(//o)  --  p^gV(^A)]  of  (3.31).  Hence,  we  have  to 


show  that 


ap{Ho)  -  hp{H^)  <  (1  -  P%^)piHo)  - 


Since  we  have  assumed  that  a  <  I  —  h,  the  following  holds 

(1  --  l>)p{fIo)  -  bp{Hi)  <  ap{IIo)  -  bp{Hi) 

Thus,  we  need  to  show  that 

(I  -  b)p{Ih)  -  bp{Hi)  <  (I  -  P%'')p{Ho)  -p^~^p{Ih) 


This  reduces  to 


-/»p(ffo)  -  bvilh)  <  -p^^piHo)  -  7Cp(f/t). 


b  >  p*f^  ^p{Ho)  + 


(3.33) 


L 


Since  a  +  h  <  I  and  b  <  fi,  b  <  TluTefore,  the  above  expression  can  also  be 
expressc'd  ius 

\>iV-  (■>■«) 

J'lquation  (.3.34)  repre.sent.s  the  eoiiditiou  under  which  .system  A  {xn-forms  better 
than  .system  B.  Furthermore,  a  .stricter  ino(|uality  can  be  obtained  by  u.sing  the 
convexity  of  the  Receiver  Operating  Characteristic  (ROC),  i.e., 

Lm^  <'  1 
P'h  ~ 

This  stricter  inixiuality  is  given  l>y 


(3.35) 


1/2  >  Pa*- 


(3.36) 


or, 


Q.E.D. 


Example  3.1 

We  pursue  the  same  problem  as  considered  in  Example  2. 1  for  the  system  with 
memory,  lienee,  the  system  consists  of  two  detectors  and  a  fusion  center.  The  input 
observations  at  each  local  detector  are  also  assumed  to  have  a  Rayleigh  distribution, 
A  priori  probabilities  are  assumed  to  be  equal  and  minimum  probability  of  error 
cost  assignment  is  used.  For  simplicity  the  SNR  at  the  two  detectors  are  assumed 
to  be  etiual.  For  the  OR  fusion  rule,  we  plot  the  threshold  values  1) 

and  ~  SNR  in  Figures  3.3  and  3.4  respectively.  The  probability 

of  system  error  vs.  SNR  is  plotted  in  Figures  3.5.  The  probability  of  error  of 
a  decentralized  detection  system  without  feedback  vs.  SNR  is  plotted  in  Figure 
3.6,  Similarly,  for  the  AND  fusion  rtile,  we  plot  th(’  threshold  v.alues  1) 

and  ~  0)  vs.  SNR  in  Figure.s  3.Y  a.Tid  3.S  respectively.  Th.e  probability 

of  system  i.rror  v.s.  .'iNR  is  plotted  in  Figure  3.9  33i,c  prrdiaMlity  of  error  of 
the  decentralized  detectii  \  sy.stem  without  feedback  vs.  SNR  i.s  plotted  in  h'igurc 
3.10. 

The  plot  in  Figure  3.3  Hhow.s  tha.t  the  threshold  ~  1)  decreases  as  a 

function  of  time  t.  The  i)lot  in  Figure  3.4  .shows  that  tlie  thn^sliohl  //[(T'-fr'  “■  0) 
increases  aa  a  function  of  time  and  as  a  funcl.iou  of  SNR,  Thenifore,  a;  time  t 
goes  to  infinity,  the  threshold  T/l(up~^  -  1)  goes  to  zero  ajid  --  0)  goes 

to  infinity.  The  plot  la  Figtire  3.5  shows  that  th<^  i)robability  of  system  error  pf,,j 
dec.n^asc.s  as  a  function  of  time  and  -as  a,  function  of  SNR  as  expected.  In  addition, 
we  (jl), serve;  tiiat  the;  dev.entralizecl  <le’.i.';ctk)n  sysi-enn  without  toed  back  lias  the;  .same 
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SNR  (ilB) 


Fig.  3.3;  Threshold  values  given  that  uf,  ^  -  1,  OR  rule 
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probability  of  error  as  the  system  with  feedback  when  one  sample  is  processed  at 
each  local  detector.  As  the  number  of  samples  per  detector  increases,  h  is  seen 
that  the  decentralized  detection  system  with  feedback  and  memory  (Fig.  3.5)  has 
a  lower  probability  of  error  than  that  of  the  conventional  decentralized  detection 
system  (Fig.  3.6).  Furthermore,  goes  to  zero  as  SNR  increases  to  infir.ity  and 
as  time  step  t  goes  to  infinity  .  The  plots  corresponding  to  the  AND  fusion  rule 
shown  in  Figures  3.7,  3.3  and  3.9  follow  a  similar  behavior  as  those  for  the  OR 
rule. 

Asymptotic  Results 

In  the  above  numerical  cxam.ple,  we  observed  that  as  t  increases,  the  system 
probability  of  error  decreases.  It  would  be  of  interest  to  examine  the  asymptotic 
behavior  of  the  probability  of  error.  This  result  is  presented  next. 

THEOREM  3.4 


For  the  distributed  detection  system  with  feedback  and  memory  .shown  in  Fig¬ 
ure  3.1 ,  the  ,sy, stern  p.  obability  of  error  goes  to  /,ero  as  the  uinnlu;!  of  time  steps  t 
goes  to  infinity,  i.e., 

pI^  -  0. 

Priiof: 

We  call  upon  tin;  asymptotic  bound.s  on  perforruauce  discussed  in  Bl;:.hnt  [35]. 
i'br  the  hypothesis  testing  problem,  it  has  shown  that  as  the  iiunilmr  oi  inde- 
pondi.Mit  idi'uticelly  ili.slriltuted  measnrement.-j,  n,  go«;s  t,o  iuhnity,  tJie  jirobability 
of  i.nn;:;  and  hd.se  alarm  go  to  ;-^ero,  i.e., 

:  IJ 

i.ha,,  :  n. 

/‘) 


With  these  two  results  in  mind,  the  probabilities  of  miss  and  false  alarm  of  a  local 
detector  in  a  decentralized  detection  system  without  fee<lback  both  go  to  zero.  The 
probability  of  miss  and  false  alarm  of  the  decentralized  detection  system  without 
feedback  is  given  by 


o|(y')  n 

Pm,  n  P% 

(3.37) 

u< 

«e-So 

ieSi 

Jit/')  n(i 

-  Ph)  n  p/. 

(3.38) 

f;'  »e5o  if^s, 


where 

6o:  till:  set  of  detectors  deciding  0  in  W . 

Si'  the  sot  of  detectors  deciding  1  in 

Notice  that  Equation  (d.37)  is  a  summation  over  all  possible  values  of  IP.  When 
ry*  consists  of  all  I’s,  we  assume  that  p(«o  —  0|/7*)  =  0  for  any  reasonable  fusion 
rule.  For  all  other  vrdues  of  IP ,  at  least  one  will  exist  which  goes  to  zero  as  t 
goes  to  infinity.  Thus, 

Hint  p,‘„  ”  0. 

In  a.  similar  Casluon,  tlii!  probability  of  false  alarm  goes  to  zero  a.s  well.  Using  the 
results  of  'I'lieorem  (i.e.,  the  system  proba.bility  of  cnor  of  flu;  (lecentralizeil 
deteefiou  .iysteni  wifcli  fitedljuek  and  uKunory  is  equal  to  or  less  than  the  probability 
of  (UTor  of  tiu’  decentralized  detection  sy.st(;ni  without  fi:.;d]).'u'k),  the  following  hold, 


Therefove, 


Unit.  0 

r-  0. 


lirnt..., 


ij*'  -  !) 

"'J'*  <  ro 


Q.K.D. 


!■’.() 


Substituting  the  results  of  the  above  theorem  in  the  threshold  Equation  (3.5)  for 
=  0,1  it  can  be  shown  that  the  following  properties  hold, 

=  0)  oo 

limt^oo  —  1) 

Tlv^yf'fore, 

=  0)  =  0 

/zjnt_cop/o(“*~*  =  1)  =  I 

~  ^ 

=  1)  =  0. 

The  probability  of  detection  =  i),  i=0,l,  can  be  obtained  from  the  above 

]>roperties  in  a  straightforward  manner. 

The  performance  advantage  exhibited  by  the  decentraliiised  det(;ction  system 
with  feedback  and  memory  Is  useful  in  many  practical  situations.  Unfortuua,l.fdy 
increased  commuiiicatioii  between  local  detectors  ami  the  global  d(!(;i,sion  maker 
l)e  omes  uectiasary.  Therefore,  it  Is  desirable  to  use  some  comniiinication  protocols 
to  rodnce  the  transmis,sion  of  decisions  hetwetni  local  dcttudors  am!  the  global 
ilecision  maker.  I.n  the  next  :;<!ction,  w.o  [)ropose  and  analyze  two  protocols  to 
reduce  data  transuiission. 

3.4  Protocols 

An  iniportaril,  i'jsue  to  be  addressed  for  i.he  'tx;eutrali/;ed  detection  systcnn  with 
f(’e(lba,ck  is  tlie  d;it;i  traTisinisston  requirements.  In  this  system,  ri  decisions  a,re, 
i.rausiaitted  i'roin  the  local  d<'i.ei:tor,s  to  the  fusion  cenfsa".  The  global  flecision  is 
1,rausiiiil,t-  (!  f'rnjri  (,'<e  fn  iioii  center  tu  n  locnl  dotertovs,  Tima,  w'tlioiit,  isiy  ['r.!;.-! 
eol  i,  i.Ii.ui'  toe  .i  toisil  of  zn  transiiji.-r-ion.s  at  e.icji  time  ,",tep.  'I'lw'rfTore,  tln^  tot.il 


number  of  decision  transmissions  upto  and  including  time  t  is  2nxt  which  is  more 
than  the  data  transmission  recpiirement  of  the  decentralized  detection  system  with¬ 
out  feedback.  It  would  be  desirable  to  reduce  the  data  transmission  requirements. 
The  metric  that  we  employ  is  the  number  of  decision  transmissions  in  the  system. 
In  this  section,  we  propose  two  protocols  to  reduce  the  average  number  of  decision 
transmissions.  This  reduction  will  result  in  savings  of  system  resources  such  as 
power  and  bandwidth  etc.  in  a  point-to-point  communication  environment,  in 
communication  networking  environment,  this  savings  will  result  in  a  lower  amount 
of  traffic  yielding  .smaller  delays  and  higiier  information  througlqiuts.  In  both  of 
the  propiosed  protocols,  each  detector  k,  k=0,i,. ..,n  needs  to  store  its  previous 
decision.  We  denote  the  number  of  decision  transmissions  on  forward  links  and 
feedback  links  at  time  .sti^p  t  by  and  L\  respectively.  Next,  we  consider  the  two 
protocols  individually. 

3.4.1  Protocol  1: 

In  this  protocol,  at  any  time  sttip  t  the  global  declKiou  maker  coumiunicates  its 
decision  to  all  local  did.,  etors  that  disagree  with  it.  Therefore,  decision  transmission 
on  a  feedbciek  link  take.s  ;  hu  e  only  w'him  tin;  global  decision  maker  disagrees  witii 
the  local  detector  (:orr<',si)ondiiig  to  that  feedback  link.  'I’lius,  we  have 
Tran.sinit  global  decisioii  at  time  t  to  local  detector  k  if 

{"u  --  l,2,...,n.}. 

h'or  the  forward  link::,  luf.al  decision  is  transmitti’d  only  if  it  di.sagrees  with  the 
pieviuns  gloii;i,l  decision  iifj  ' .  Tlii'n'rorc', 

Transmit  local  deiciHion  at  time  t  from  loc.al  def,ei;tor  k  if 

{ 1  ^  ~  1 , 2, .  , ,  ,  ?i  [ . 


I'll 


wt:  e.K.imiue  i.lir-  led.uction  in  the  uuntber  ol  ilec.i.sion  tc.insimssiun-i 


icmcvcd 


when  this  protocol  is  employed.  The  number  of  forward  decision  transmissions  at 
time  t  given  the  hypothesis  Hi  can  be  expressed  as: 

and  the  number  of  feedback  decision  transmissions  at  time  t  given  the  hypothesis 
Hi  is: 

jt=i 

wliere  I(.)  is  the  indicator  function  given  as: 

[  I  if  (.)  true 

/(.)  = 

[  0  otherwise 

We  observe  that  both  TJj  and  are  discrete  random  variables  taking  values  in 
[0,n]. 

The  average  number  of  decision  transmissions  under  the  hypothesis  //,•  is  found 
by  taking  the  expectation  of  the  above  random  variables.  Tlierefore, 

Avt'irage  number  of  forward  decision  transmissions  at  time  t: 

<'\m 

fc=ti 

Average  number  of  fcedl)a.iTk  decision  transmissions  at  tiuui  t: 

I'Hf-Hi))  -  E  '■:{!«  f  4ia)} 

)i--\ 

Next,  we  pn'sent  'I'heorcra  d.h  where  tlie  average  number  of  (Iccisiun  transiiiissious 
uiultn  this  protocol  is  expressed  in  terms  of  the  systerTi  f);n’ame1,i't::. 


TIIEOREAT  3,5 

( ,'onsidcT  t,hi;  decentralized  <letcc:r.iou  system  with  feefilvu'k  and  memory  cfur 
si.'ii.ing  of  n  local  detector.':  and  a  fusion  center  employing  Protocol  i.  The  average 
imuiluT  of  decision  transmissions  at  time  t  is  given  by 


(I)} 


O'-'V 


where  is  the  average  number  of  decision  transmissions  under  the  hypoth¬ 

esis  H\  given  by, 


E{L’(l))  =  l)(r.-2a,ipi.,(Kj-'  =0)) 

+P*'4(“o''  =  =’  1)  -  >0  (3.40) 

and  '£^{^*(0)}  is  the  average  number  of  decision  tran:  ussions  under  the  hypothesis 
//o  given  by, 

i=l 

+(i-;>r)(i~4K-'‘  =  0)) 

^(2  5Zpa(“o~^  0)  -  ^0  (3.41) 

k-i 

Proof; 

Recall  that: 

fc=i 

A..  I 

'These  can  also  be  written  as: 

^  '  ^P(’4  ^  (;h4‘2) 

*.-1 

■/  (3.43) 

Jtrxl 

Now,  we  proceed  to  derive  the  average  number  of  decision  transmissionrs  )} 

and  L'{Ll(])}  separat<4y  as  folb»ws: 

(I)  p;{/4(i)}: 

(a'li.sidcr  tin-  term  of  t)u*  !;umniatio!i  (3. 12).  Writing  it  explicitly  ui  terms 
of  all  po.ssible  < ooibiuations  of  and  *  such  that  nj.  -f-  n[)  V.  We  ha.ve. 


lir-t'i 


Conditioning  on  Uq  ^  and  expandin  we  have 

p(ui  ^  =  phi  ==  =  0,.ffOp(«o“‘  -  0|.f/.) 

+phi  =  0|n‘--'  -  1,  H.)p(t4"'  = 

Summing  this  over  all  detectors  we  get  the  average  Ti.umber  of  decision  transmis¬ 
sions  on  the  forward  links: 

=  E  -''K  ^  -  Ih4“^  =  0,  =  o|if.) 

*=i 

+p(4  =  oK'  = 

Letting  /f,-  =  Hi  and  rearranging  terms,  we  get 

£{iKi)}  =  ;C'  X  =  0)1 +pi;'  X  (EA.W”'  =  1)1  (3-44) 

/.=  1  Jc=:l 

which  completes  the  first  part  of  the  proof, 

(11)  i';{L^(l)}: 

Starting  with  Equation  (3.43),  we  expand  the  term  of  the  sunnnatinn  by 
introducing  the  previous  global  decision  Uq'~^  as  follows: 

p(«!,  >4|H.)  -  E  p('‘i  ^  “t 

We  write  this  in  terms  of  all  possible  decision  combinations  such  that  (if,  ^  nj.: 

/'( '‘o  4  )  =  E  I’i  “«  ~  *  ’  '‘1  ""  "u“ '  I  ) 

'4- 

pp(ii'  --  0,  <4  ~  1 ,  (4'*|f/,) 


( ,\)uditioning  on  nf,  and  n‘,  and  expanding,  we  hav<'; 

p(u'  4  ul|/7.)  M4  =  Oluf,  --  1,  nf,  \  /f.)p(-‘  -  //.)p(u,rM/A) 

M'4  -  i|«n  -  <h  ff.)p('4  -  d|»'r',  f/.)p{u,V|//,) 

Hearr.inging  ,and  oliserving  that  nf.  --  i  conditioncii  on  ?((,'  *  .vnd  7,  i;;  indepciuh'ut 
of  f/f),  vve  have 

/'( '4  /- )  -  E  I’i  ‘  )  fp( K  '  d I  ul;'  ‘ ,  H, ) n{  (if,  1 1  nf,"  ’ ,  /v, ) 

t  -  ! 

'*0 

'■/'('■'a  , 'o)| 


Suinniiiig  over  all  detectors  and  letting  ff,-  —  Hi  yields  the  average  number  of 
fetxlbaclc  decision  transmissions, 


E{LI{1)]  =  ■£ 


ELiIpK  -  HMu^o  =  l|u^\  Hi) 

\-p{ui  =  Hi)p{u^o  =  0|74"\  Hi)] 


This  could  be  rewritten  iu;: 


E{Ll{l)}  =  X!  P("o  X  j4(“o  X  ‘)] 

,,<-1  k=r.l 

“o 

(3.45) 

Substituting  pi  (uf|~‘)  by  1  pi,_(ufr’)  rearranging,  we  have 


'‘q"* 


k=l 


Finally,  sununing  E{Ll{l)}  and  E{Hf{l)}  we  obtain  the  result  of  Kqnation  (3.40). 
In  a  similar  manner,  we  may  derive  the  results  given  in  (3.41).  I‘’inally,  the  results 
of  (3.40)  and  (3.41)  can  he  used  to  obtaiti  the  overall  result  of  Equation  (3.3!)). 

Q.E.D. 


Next,  we  roasider  the  asymptotic  behavior  of  the  average  number  of  uata 
tj  aiisuiissions  under  l.hi.s  protocol  and  pres«‘nt  the  res\dt  in  launiiui  3.1. 


Lemma  3.1  : 


When  I’rotocol  1  is  use<l,  the  average  nmul)er  of  derision  tiansinissiou.s  E{  fJ} 
fr)r  the  .system  iiniier  roiusidertation  goes  to  /eu)  a.s  the  number  of  tiiv’e  slaqrs  t 
inrre.ujes  to  iidinity. 

Proof: 


Wt;  u'eall  i.lie  asymptutif'  i)rr»iierti«‘s  of  tin*  dciy'ntrrilived  d.-'ter.tion  system  with 
metnory  ;i)i'l  fcedl'.M'k  from  S  ’ction  3.!!  to  prove  thi::  beinuia,  namely. 


;u. 


■-=  0- 

=  L)  0,  k=l,2,. . .  ,n. 

lirnt^ocPd^b/o'’^  =  1)  =  1. 

Using  these  asymptotic  properties  in  (3.40),  we  have 

limt.^^E{L*(l)}  ~  0 

Similarly,  it  can  he  shown  that 

Therefore, 


Q.E.D. 

N<‘Xt  we  consider  another  protocol  for  tlie  reduction  of  decision  t.ransmission.s. 

3.4.2  Protocol  2: 

In  this  protocol,  at  any  time  step  t,  the  gloh.nI  decision  maker  (■om:nmncat(',s  its 
ilecisioii  to  all  the  local  detectors  when,  it  disav,rees  with  I  he  [.>re\‘ious  gloh.d  deci 
si(jn.  Therefore,  a  fe<*d!)ack  decision  tr.ansmi.ssion  m!  all  re<‘dh.n’k  links  lakes  place 
when  the  <  urrent  gloh.d  (h’eision  ilisagree.s  wit!\  the  previous  aloh.i!  ■  ie'-isioii ,  i c  , 
Transmit  glohal  ilecision  at  timet  to  .4 II  li>.a!  .l.a.-.t. jf 
For  the  forw,ard  links,  loeal  de<’ision  is  tr-insuiitted  oii  the  tm-w.tiii  link  e.nK 
if  it  (iisagns'  i  wiili  I  lie  pievioiis  lot  .il  <ie(  isioi,>  ’  .  Hence, 

Ir.ansniit  local  decision  Irou.i  .1  lo<  al  d«-teclor  k  P  { J 

Tiie  redueti(..'n  in  1  he  average  nmnh«‘r  of  ihaision  t ransncissi, e;-.  ,1. .0 
'  tnidoying  tins  protmol  r,  ex.imined  ui-x!.  We  ex[i;<  tin-  fenrCi.  1  ..i  ’.ir'A.i, 


decision  tranamitisioris  given  the  hypothesis  //,-  as; 

Jt=l 

and  the  number  of  feedback  decision  transmissions  given  the  hypothesis  Hi  as: 

fc=l 

where  !(,)  is  the  incdcator  function  defined  earlier.  We  observe  that  both  Hf{i) 
and  Ll{i)  are  discrete  random  variables  taking  integer  values  in  [0,n]. 

The  average  number  of  decision  transmissions  given  the  hypothesis  Hi  is  found 
by  taking  tbe  expectation  of  the  above  random  variables.  Therefore, 
yi.verage  number  of  forward  decision  transmissions  at  time  t: 

£(£/(<)l  = 

k~l 

Average  number  of  feedback  decision  transmissions  iit  time  t: 

A-l 

Next,  the  average  number  of  decision  transmissions  lor  this  protocol  is  presented 
in  Theorem  3.6. 

THEOREM  3.6 

Consider  the  docentralL^ed  detection  system,  with  feedback  and  memory  c.jn- 
sisting  of  n  local  detectors  and  a  fusion  center  employing  Protocol  2.  The  av-Trage 
number  of  decision  transmissions  at  time  t  is  given  by 

/^{//}  ==  p(i/o)^’{T‘(0)}  +  p{H:)lHj/{].)}  (3.47) 

where  £'{Z,‘('i)},  i=-0,l,  Is  the  average  number  of  decision  transmissions  at  time  t 
under  the  hypothesis  Hi  and  given  by, 


«8 


lit  If^aoPmo 

lirrii^ooPd^  ~  1. 

(^0  ~  ^)  ' ^ — 1,2, ...jn. 

/im^.,oopio('“o~^  =  1)  =  1. 

Using  these  asymptotic  properties  in  (3.40),  we  have 

/im,. .«,£{£*(!)}  _-=  0 

Similarly,  it  can  be  shown  that 

limt,^c^E{L‘{0)}  =  0 

Therefore. 

/fm,^oojE{//}  —  0 


Q.E.D. 

Next  we  consider  another  protocol  for  the  red  icticn  of  decision  t.ransmissions. 

3.4.2  Protocol  2: 

In  this  protocol,  at  any  time  step  t,  the  global  decision  maker  communicates  it.s 
decision  t-,'  all  the  local  detectors  when  it  disagrees  with  the  previous  global  deci¬ 
sion.  'Fherefore,  a  feedback  decision  transmission  on  all  feedback  links  takes  place 
when  the  current  global  decision  disagrees  with  the  previous  global  decision,  i.e., 
Transmit  global  decision  at  time  t  to  all  local  detector.^  if  (r/t, 

For  the  forward  links,  local  decision  is  transmitted  on  the  k^'’’  forward  link  only 
if  it  disagrees  vuth  the  previous  local  decision  ul~^  .  Hence, 

Transmit  local  decision  from  a  local  detector  k  if  /- 

The  reduction  in  the  average  number  of  decision  transmi.ssious  achieved  by 
employing  this  protocol  is  exauiijur!  next.  We  express  the  number  of  forw  u;d 
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The  average  number  of  feedback  decision  transmissions  E{Ll{i)}  ,i--0,l,  at  time  t 
ai'e  given  by 

E{Llil)}  =  n  X  -  1)  X  =  0)  X  pj,:;]  (3.48) 

E{Ll{0)}  =  nx  [(T  =  1))  X  Ph' 

+P/o(“o'"^  =  0)  x  (I  - (3.49) 

The  average  number  of  forwaid  decision  transmissions  £’{Zf^(z)},  i~0,l,  at  time  t 
are  given  by 

E{L‘j{l)}  -  E  ^  +pM~')  X  ^^2  (3.50) 

A:=:l 


where  h  --  E„‘-=  Pd^H^o  )  x 

A;1  -  p(74■■^|74"^■ffl)  X  p(t4  '^l//l). 


E{f/jiQ)}  =  iZPhi^o^')  X  La  +  (1  -•  X  ^■'4 


(3.51) 


where  Lg  =  ^))  X  LO 

kO  -  p(uo~N^o“^  Lfo)  X  p(uo"^|ffo). 


Proof: 


n 


A'{r/(0}  =  EX4?^“ir'|7f.) 

i-ri 

(3.52) 

(3.53) 

Ar,  before, 


Now,  we  proceed  to  derive  the  average  number  of  decision  transmissions  for  any 
Hi.  The  final  results  are  obtained  only  for  the  case  Hi  ~  H\.  The  results  for 
the  Hi  =  Hq  case  can  be  obtained  in  a  similar  fashion.  We  derive  jE{Ty(l)}  and 
£'{£[(  1)}  separately  as  follows: 

(1)  mtm 

We  observe  that  in  Equation  (3.53),  the  summation  argument  is  independent 
of  the  summation  index  k,  hence 


E{Ll(i)}  =  nxp(u‘^unHi) 

Expanding  in  terms  of  all  possible  decision  combinations  such  that  Ug  ^  Uo~^, 
"  X  [p('“o  =  llHi)  +p(uo  =  =  Oji^i)] 


Conditioning  on  Uq"'  and  expanding 

E{Li(t)}  =  nx  =  OK'  = 

+p(u‘  =  IIK^  =  0,  Hi)p(u‘o~'  -  0|/f,)]  (3.54) 

Substituting  //,•  -  Hi  and  rewriting  in  terms  of  and  pj^  we  get 

£{^(1)}  -  nK(K'  =  1)  X  p^;'  4-p^,(K'  =  0)  X  p‘';^] 

Similarly,  letting  =  f/g  in  Equation.  (3.54),  we  have 

E{Lim  =  -.((1  -  =  1))  X  p};' +?;..«-■  =  0)  X  (1  - 

a?;  stated  in  Equations  (3.48)  and  (3.49). 

(H) 

VVe  introduce  the  previous  global  decision  into  Equation  (3.52),  hence 


■i"  *=' 

Flxpanding  in  terms  of  all  pos.sib);;  decision  combinations  such  that  ^ 

E{L){i)}  ^  p(u(.  ==  r-:  l,u‘ ■»|/-/.) 

,/  -1  k-^i 


+p(Tt5.  =;  1,1'.!' 


9(J 


(3.55) 


Conditioning  on  ul  ‘  and  Uq  ^  and  e:  panding,  we  havc^ 

=  E  E  p("i  “  oK"'  = 


,,<-1 


-fp(4  =  IK  ^  =:  0,  ^  0,Uo"Mir,)  (3.56) 


Observing  that  the  local  decision  conditioned  on  Uq  ^  and  is  independent  of 
we  rewrite  the  above  as: 


-EE  pK  ==  0|nr\i7.)  X  ri(f) 
4-p(4-  l|wo~\^.)  x7’,(2) 


(3.57) 


where  Tt(i)  and  T::(i)  are  n.sed  for  notational  convenience  as  follows 

TAzl  =  p(ui-^  =  0,nrm 

The  terrr;.s  Ii(i)  and  T2(i)  cannot  be  evaluated  yet  and  need  further  work.  Intro¬ 
ducing  Uq"'*  Into  7'i(z)  and  conditioning  on  Uo"^  and  ,  we  get 

j',(o  =  e>(“4  '■ 

«r’ 

Further  conditioning  the  last  term  on  zifT^  and  observing  that  ul~^  conditioneil  ou 
«o  ^  and  /7,  is  independent  of  ao''S  we  have 

ri(z)  .T.  p(ul-'  -rr.  7f.)p(t4"'|n‘''^  /7,)p(n(,~-|//,)  (3.58) 

In  a  similar  fashion,  T^ii)  is  obtained  as: 

'fW)  -  E  pi '4"’^  -  0^Wo~^  4«o"^  (3.59) 

For  i— 1,  '/^(J.)  and  7'2(i)  can  be  written  a.s: 

''40  -  Ez4’(4  0  xpK  ’|/V^)p«0^:) 


'J1 


(3.60) 
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T2:i)  =  E  X  (3.61) 

It  is  seen  that  I\(l)  and  72(1)  are  the  same  as  Li  and  L2  respectively  in  Theorem 
3.6.  Similarly,  for  1=0,  Ti(0)  and  T2(0)  are  the  same  as  and  L4  in  Theorem  3.6. 
Therefore,  the  average  number  of  decision  transmissions  is  evaluated  by  substitut¬ 
ing  the  results  of  Equations  (3.48)'(3.50)  in  Equation  (3.47). 

Q.E.D. 

The  asymptotic  behavior  of  the  average  number  of  decision  transmissions  under 
Protocol  2  is  considered  in  Lemma  3.2  next. 

Lemma  3.2  : 

When  Protocol  2  is  used,  the  average  number  of  decision  transmissions  E{//} 
for  the  system  under  consideration  approaches  zero  as  the  number  of  time  steps  t 
increases  to  infinity. 

Proof: 

Again,  we  call  upon  the  asymptotic  properties  as  listed  in  Theorem  3.4,  namely 

-  0. 

1. 

/zmt_.ooP(„,.(wo~‘  -  1)  0,  k=^l,2,..  .,u. 

--  1)  =  1. 

Using  these  properties  in  Equations  (3.48  )  and  (3.49)  it  can  be  shown  that  the 
average  number  of  decision  tran'imi.s.sions  given  the  hypothesi.s  f7i, 
goes  to  zero  a.s  t  goes  to  infinity.  In  a  similar  fashion,  the  average  nun)ber  of 
decision  transmissions  given  the  hypothesis  Ho,  E{rJ{Q)}  goes  to  zero  as  t  goes 
to  infinity.  Therefore,  the  average  number  of  decision  transmissions  for  this  second 
protocol  /?{//}  goes  to  zero  as  t  goes  tt^  infuuty. 

Q.Ei). 


'J2 


Next,  we  present  a  numerical  example  that  shows  the  behavior  of  the  average 
number  of  decision  transmissions  E{L*}  for  Protocols  1  and  2. 

Example  3.2 

We  further  pursue  Example  3.1  and  investigate  the  performance  of  the  proto¬ 
cols.  For  both  Protocols  1  and  2,  we  plot  the  average  number  of  decision  trans¬ 
missions  E{L*}  vs.  SNR  tor  the  OR  and  the  AND  fusion  rules.  The  results  given 
in  Theorems  3.5  and  3.6  are  used  for  the  computations. 

The  plots  of  Figures  3.11  and  3.i2  show  that  for  the  OR  fusion  rule,  the  aver¬ 
age  number  of  ded.sion  tj'ai  is  missions  for  both  the  first  and  the  second  protocols 
decrease  as  SNR  values  increase  and  a.s  time  step  t  increases.  From  Figures  3.11 
and  3.12,  it  is  seen  that  the  average  number  of  decision  transmissions  for  Protocol 
1  decreases  more  rapidly  than  Protocol  2.  The  plots  of  the  average  number  of 
decision  transmissions  for  Protocols  1  and  2  for  the  A  ND  fusion  rule  are  given  in 
Figures  3.13  and  3.14  respectively.  The  average  number  of  transmissions  E{L^} 
is  ob.servcd  to  be  decreasing  again  as  was  the  ca.se  with  the  OR  fusion  rule.  It 
is  interesting  to  note  that  ivs  t  goes  to  infinity,  the  average  number  of  decision 
transmissions  goes  to  Tioro  for  both  protocols  ,  i.e.  no  decision  transmissions  are 
required  on  an  a,verage. 


3.5  Di.sci.ission 


In  this  chapter,  we  liave  coasider(;d  a  (lecentralized  detection  system  with  feed¬ 
back  and  meniory.  The  incorporation  of  memory  at  the  local  detcctor.s  provifled  a 
con.siderable  enhauce'ineiit  fi'v  tJu;  .system  performance.  T'hi.s  system  wa.s  optimized 
using  the  Bayesian  Ibnuulatiou.  U,;iug  the  PBPO  solution  methodology,  we  derived 
decision  rules  for  the  local  detect*  h-h  ajid  the  fusion  center.  'Plu;  system  proluibility 


Ave.  no.  of  transmission 


Ave.  no.  of  transmission 


of  error  was  derived  and  shown  to  be  at  least  as  good  as  that  of  the  conventional 
decentralized  detection  system  without  feedback.  The  system  probability  of  error 
was  shown  to  decreases  to  zero  as  the  number  of  observations  increases  to  infin¬ 
ity.  An  important  issue  that  arises  in  this  system  is  that  of  decision  transmission. 
Due  to  the  feedback  links,  the  system  is  characterized  by  an  increase  in  decision 
transmission.  We  proposed  and  studied  two  protocols  to  reduce  decision  transmi.s- 
sion  requirements.  The  average  number  of  decision  transmission  was  shown  to  go 
to  zero  asymptotically  when  Protocol  1  or  2  is  deployed.  Numerical  results  were 
obtained  for  a  system  of  two  detectors  and  a  fusion  center.  Using  the  OR  fusion 
rule,  the  decentralized  detection  system  with  feedback  and  memory  was  shown  to 
have  a  lower  probability  of  error  as  compared  to  the  conventional  decentralized 
dei.ection  system.  Similar  results  were  found  for  the  AND  fusion  rule. 
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Chapter  4 


A  Unified  Approach  to  the 
Decentralized  Detection  Problem 


4.1  Introduction 

la  the  previous  chapters,  we  have  considered  the  pioblem  of  Bayesian  hypothesis 
testing  in  decentralized  detection  systems  v/ifcli  feedback.  Several  other  decentral¬ 
ized  detection  network  topologie.s  have  been  investigated  in  the  literature,  e.g,,  the 
conventional  decentralized  detection  network  without  feedback,  the  serial  network, 
the  hierarchical  network,  etc.  .  In  thi.s  chapter,  we  provide  a  unified  rcprest;nta 
tion  for  different  decentralized  detection  network  topologie.s.  This  representation 
is  in.spired  by  the  definition  of  information  structure  given  in  [22,  23].  This  unified 
representation  is  then  used  to  obtain  PBPO  decision  rules  for  various  decentralized 
detection  systems. 

In  Section  4.2,  we  define  tlu;  communication  tjtructure  of  organizations  ra;  it 
applit^  to  team  decision  making.  It  is  .shown  a.s  to  how  a  number  of  decoutndized 


at  the  det  xtor  corresponding  to  the  column  k  are  given  by  the  column.  We 
define  the  decision  input  of  the  detector  as  follows; 

h~{ui  :  Dik  --  1;  for  all  i}  (4.1) 

Thus,  decentralized  detection  systems  i^it.h  any  configuration  can  be  specified  in 
terms  of  the  communication  matrix  D.  Next,  we  present  a  couple  of  examples 
illustrating  the  comnumication  structure  representation  of  decentralized  detection 
systems. 

Example  4.1: 

Pbr  a  serial  system  consisting  of  N  detectors  with  observations  y,-  at  each  de¬ 
tector  i,  i  =  1,  2,  ...,  N(Figure  4.1),  the  matrix  D  is  given  by  an  off  diagonal  matrix 
of  dimension  N  x  N  follows: 


(let.  no.  1  2  3  4  •  •  •  iV 


D  ■- 


1 

2 

3 

1 


/o  1  0  0 
0  0  10 
0  0  0  1 

0  0  0  0 


•0 
•0 
•0 
••0 
•  •  1 


AT  \0  0  0  0  •••0/ 

The  entries  of  the  matrix  are  obtained  from  the  block  cl  agrarn  of  the  serial  system. 
Dete  or  numbers  are  also  indicated  for  convenience  of  the  reader.  The  (i,k)  clc 
ment  i.s  one  if  detector  i  transmits  its  decision  to  detector  k.  For  example,  Dn  =  1 
indicates  that  the  decision  of  detector  1  is  fed  to  detector  2.  Using  Equation  (4,1.), 
the  decision  input  of  the  detector  i.s  given  by, 


In  ■=  Un~i 


I'ho  first  column  of  the  1)  lu.atrix  has  all  zero  entries  indicating  tlial.  tli  e  is  no. 


decision  input,  i.e., 


Ii  —  no  input 


Example  4c2: 


For  ii  decentralized  detection  system  with  a  fusion  center  consisting  of  n  local 
detectors  (Figure  4.2),  the  coniniunication  matrix  D  is  of  dimension  (n+l)x(n+l) 
and  given  by: 


D 


1  2  ■  •  •  «  0 
'"OO  •••0  1^ 

no  0  1 


7 


n  I  00  •••  0  1 
0  \^00  •••0  0 

Note  that  the  global  decision  maker  is  denoted  by  detector  number  0  and  it  appears 
in  the  last  row  and  column  of  the  matrix.  As  seen  form  this  matrix,  there  are  no 
decision  inputs  to  the  detector, 
k— 1,2,. .  .,n,  i.e., 

Ik  =  no  input 

However,  the  colunm  corresponding  to  detector  0  (the  global  decision  maker)  has 
the*  following  decision  input. 


Iq  --  (^^li  U-;-  .  .  .  , 

The  Generalized  Coramunicatica  Structm*H 

Tlie  ropr.csentation  of  decentralized  detection  systems  in  terms  of  tlie  commu¬ 
nication  structure  can  describe  systems  which  are  connected  in  the  form  of  a  tree 
and  where  the  decisions  flow  only  in  one  direction  nfuxwdy  towards  the  fusion  cen¬ 
ter.  However,  this  repi’esent  -.tion  is  not  a  lequate  for  representini  der.enotralized 
detection  networks  with  more  general  network  topologies  such  gs  the  decentralized 


Local  detector  1 


1 


Fip.  4,2:  A  decentralized  detection  system 
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detection  network  with  fet;uback  considered  earlier  in  thi?  dissertation.  Therefore, 
we  fj;eneralize  the  definition  of  the  communication  structure  by  including  the  time 
parameter  t.  We  assume  that  each  detector  in  a  given  system  produces  a  time  delay 
of  one  unit.  Consider  the  connected  graph  corresponding  to  any  given  decentral¬ 
ized  detection  network  topology  where  the  nodes  represent  the  decision  makers  and 
the  decisions  flow  along  the  directed  edges  of  the  graph.  Recall  the  fact  that  the 
fusion  center  is  rcspon.sible  for  making  the  final  decision.  We  organize  and  label 
the  graph  in  terms  of  levels  such  that  the  fusion  center  is  at  level  zero  and  the  level 
of  other  nodes  is  determined  by  their  distances  from  the  fusion  center  (number 
of  edges  traversed  from  the  fusion  center  to  the  noile  under  consideration).  We 
illustrate  this  iu  Figure  4.3  where  a  decentralized  detection  network  with  a  gern^ral 
(non-tree)  topology  alongwith  its  corresponding  graph  is  shown.  We  employ  the 
above  connected  graph  to  a.s.sign  the  time  index  to  each  of  the  detectors  of  the 
decentralized  detection  network.  The  time  index  of  a  detector  is  simply  its  level 
in  the  connected  graph.  The  time  indices  of  the  detectors  are  displayed  alongwith 
the  detector  nunilier  in  the  communication  matrix  D.  Finally,  the  input  decision 
vector  of  the  detector  corresponding  to  the  column  is  given  !)y: 

li  :  Dik  ■---  1;  for  all  z}  (4.2) 


where 

c^.  is  tin;  time  iud(;x  of  the  detector  corresponding  to  the  column, 
is  the  time  index  of  the  detextor  correspoiidiug  to  tin;  row. 

For  the  decentralized  detection  sy.sLein  of  Figure  4.3,  the  communication  matrix  is 


Fig,  4.3:  A  general  (non-rrec)  decentralized  deiec'tion  systen; 
with  th  ’  cniresponding  connected  graph. 


given  by, 


time  index 


D  = 


I  det.  no. 


1 

1 

2 

2 

0 


1 

2 

3 

4 
0 


1  J  2  2  0 
1  2  34  0 
^00001^ 
00001 
10000 
10000 
J  1  000^ 


The  decision  input  vector  [{  for  the  first  detector  is  obtained  from  the  first  column. 
The  column  time  index  is  given  by  cj  --  I  ;uid 


{+2-1-1  ,,{+0-1-1 


0 


Next,  we  further  illustrate  the  applicability  of  the  generalized  representation  by 
consid{;ring  the  following  examples. 

Example  4.3; 


In  this  exam[)le,  we  look  at  tlie  serial  network  of  Example  4.1  and  obtain  the 
time  indice.s.  'riu;  com  muni  cation  matrix  D  is  giv  u  by 


time  mde.x  — » 

J.  det.  no. 

N  -  1  I 

N'  -  2  2 

n  r-z 

N  -  3  .3 

1  /V  -  1 
0  N 


IV-  L  . 0 

1  2  3  4  ••■/V 

^0  1  0  0  •••0^1 
00  1  0  ••■0 
0  0  0  1.  •■■0 
:  :  .••••.••.() 

0  0  0  0  :  1 
V’ . oj 


Once  again,  the  time  indices  aiul  (h.dector  numlnn.H  ;u’e  iuc.ludcd  for  t]i.e  C'mV{niieiiC(! 
of  tlu;  rc'ader.  'The  time  index  c;  (time  index  of  the  det(;ctor  coro;.sponding  to 


to/ 


column  k)  of  the  non-!«ero  entries  in  the  matrix  D  could  be  written  in  terms  of  the 
time  index  r,-  (time  index  of  the  detector  corresponding  to  row  i)  as  follows: 


Ck  ~ri+ I 


Hence,  the  input  decision  vector  consists  of  one  decision,  namely  the  previous 
fletector  decision 


r  — 

1 


If 


n-1 


This  indicates  that  the  decision  of  the  (n  —  1)'^‘  detector  is  used  in  the  detector 
decision  making  without  any  further  delay. 


Note  that  the  time  indices  and  detector  numbers  along  the  columns  are  repeated 
along  the  rows.  Therefore,  for  brevity,  from  now  on  we  will  provide  this  information 
only  .ilong  the  rows. 


Example  4.4: 

We  consid(!r  the  decentralized  iletection  system  with  a  fusion  cmiter  as  given 
in  Example  4.2  and  obtain  the  time  iiuliees.  The  communication  matrix  D  is  of 
dimension  (n+ l)x(uf  1)  and  is  given  by: 


I  1 

^00- 

••01^ 

L  2 

0  0- 

••0  1 

i  ii 

00- 

••01 

U  U 

^00- 

••00^ 

It  is  seen  that  all  the  local  detectors  have  the  same  time  index.  'Fhe  time  index 
r,-  of  the  non-z.ero  entries  is  given  by  e,-  1,  i— l,2,...,n  ,  and  the  time  index  Co  is 

given  by  ffo  “  0.  Hence,  the  time  parameter  of  tlie  local  de.dsioiis  ai  the  global 
decision  maker  is; 

t  \  ri  -  r,i-  \  i  I  t 

loa 


waaiiiA'i 


The  decision  input  at  the  global  decision  maker  7q  is,  therefore,  given  by, 

II  ~ 

Local  detectors  have  no  decision  input  as  seen  before. 

Example  4.5: 

We  consider  a  decentralized  detection  system  with  feedback  os  shown  in  Figure 
4.1.  The  system  consists  of  n  local  detectors  and  a  fusion  center.  The  number 
of  levels  in  this  system  is  the  same  as  that  of  Example  4.4,  hence  the  same  time 
indices  are  obtained.  The  coininunication  matrix  D  is,  therefore,  given  by: 

I  1 
1  2 
D-  :  i 
.!  n 
0  0 

Observe  the  effect  of  feedback  on  the  matrix  D.  The  bottom  row  indicates  that 
there  is  a  comiminicatiou  link  from  the  global  decision  maker  (detector  0)  to  all  the 
local  detectors.  Note  that  the  decision  input  of  the  local  detector  corresponding 
to  the  column  k,  k— 1,2,. . has  a  time  index  of  one,  i.o.,  ci^  —■  1.  'iMio  decision 
input  of  the  local  detector  correspoiuling  to  the  column  k  is  given  by 

/(.  -  ~  for  any  local  detector  k. 

As  seen  above,  the  global  decision  input  to  the  local  detectors  has  a  f.iTne  par,anK;ter 
of  t-2  which  indicate;;  that  two  l.inie  delays  are  encountered,  the  local  detector  delay 
and  the  global  decision  maker  d(;lay.  ft  is  important  to  note  that  our  earlier  results 
from  Chapters  2  and  d  as.sume  that  the  global  decision  maker  doe.s  not  account  for 
any  time  delay.  Hence,  the  tiiiro  [i.j.raraetcT  of  t- 1  was  used  for  the  previous  gloljal 
decision  in  Chapters  2  .  rul  3. 

lOU 


The  decision  input  of  the  global  decision  maker  is  obtained  using  the  column, 


The  time  parameter  of  the  local  decisions  indicate  that  all  local  decisions  are  used 
without  any  time  delay. 

With  our  generalized  definition  of  the  communication  structure,  any  decentral- 
izd  detection  system  can  be  represented  by  a  communication  matrix.  In  the  next 
section  we  derive  the  decision  rules  of  all  the  detectors  in  a  decentralized  detection 
system  with  any  configuration  represented  in  terms  of  its  communication  matrix. 


4.3  The  General  Decentralized  Detection  System 

4.3.1  System  Description  and  Problem  Statement 

We  consider  the  binary  Irypothesis  testing  problem  for  a  decentralized  detection 
system  with  any  arbitrary  configuration  (.Serial  Network,  Parallel  Network,  System 
v/ith  Feedback,  (!tc.).  Let  the  number  of  detectors  in  the  system  be;  n+1.  't'he  block 
diagram  of  any  detector,  say  the  detector,  of  a  decentralized  detection  system  is 
shown  in  Figure  4.4.  Hue  to  the  effect  of  event  scqucuciag,  we  as.soeiate  a  time  .step 
parameter  t  with  all  the  system  varjable.s.  The  detector  of  the  general  system 
operates  as  follows;  At  time  step  t,  the  detector  based  (mi  the  observation  iiii)ut 
yl  and  rhe  decision  input  /(,  produces  the  decision  u[  using  the  decision  rule  7t(.) 
as  follows: 

4  =-■  IkivU  ^k) 

We  assume  that  the  joint  conditional  probability  density  of  the  observations 
pCz/o)  2/n j  —  f  F  ••■1  1'  i-'’  known  a  priori-  The  problem  is  to 

fmd  tlic  PHPO  solution  for  the  deci.sion  rule  7^(.),  k:  -0,l  ,  ...,n;  t-U,  2,  ...,  'I',  so 

1  H) 


The  k'"  detector 


J 


I’igurc  4.4:  Block  diagnim  of  the  k^  detector  in  a  given 


as  to  minimize  the  cost  function.  J{T)  for  the  final  decision  Uq.  We  consider  the 
Bayesian  formulation  where  the  cost  function  J(r)  is  given  by, 


./(F)  =  Coop(uo  =  0,  Ho)  +  CoM'Uo  =  0,  Hi) 

■4-Ciop(no  =  Hq)  -f- Ciip(uJ'  =  (4.3) 

where  Cjj;  1,  j  =  0,  1,  is  the  co  :t  of  deciding  ti^  =  Hi  when  the  true  hypothesis  is 
Hj. 


The  costs  Cij\  i,  j  =  0,  1,  and  the  a  priori  probabilities  p(//o)  uid  p{Hi)  are 
assumed  to  be  known.  We  rewrite  Equation  (4.3)  in  terms  of  the  system  probability 
of  false  alarm  at  time  step  T,  pj,  and  the  system  prob.ability  of  detection  at  time 
step  T,  pj,  as  follows 

./(!’)  =  C'fp(u^  -  l\Ho)  -  CdpiuJ,  ~  lIWi)  T  C 

-  C,pI  ■  -  ^  n  (4.4) 


where 

Cf  =  p{Ho)(Cio  -  Coo) 

Cu  =  p{Hi){Coi  -  C„) 

C  =  p(ffo)Cu„  +p(//,)Coi 


It  .should  be  lujted  lliat  tlic  eo.st  function  -/(F)  of  Equation  (4.4)  is  independent 
of  the  .system  structun;  (coiifiguratioii).  Hence,  the  development  up  to  thh  point 
is  for  a  general  system.  In  the  next  sub.section,  we  derive  the  I’HPO  decision  rule 
7^(.)  in  the  detector  for  a  generu.l  system. 


4.3,2  Sy.stem  Optimization 

I.hTore  proceeding  v/ith  the  .sy.stem  opthnizatiun,  v/c  ma.kt;  certain.  siiTipl.i.fyirig  ns- 
sumi)tiouM.  We  as.sume  tliat  the  ob.servations  of  the  genera,!  system  are,  .'qjatially  as 


well  as  f.emporally  independent.  Hence,  the  a  priori  knowledge  of  the  conditional 
probability  density  functions  p{yQ,yli  j  =  0)  1;  =  f)  2?  T  reduces  to 

the  a  priori  knowledge  of  the  individual  detector  conditional  probability  densities 
p{yl\Hj);  j=0,l;  t=l,2,...,T;  k=0,l,...,n.  Next,  we  proceed  with  the  minimization 
of  the  cost  function  given  in  Equation  (4.4).  We  derive  the  decision  rule  for  the 
detector  shown  in  Figure  4.4.  The  result  is  presented  in  Theorem  4.1. 


THEOREM  4.1 


For  the  binary  hypothesis  te.sting  problem  in  a  general  decentralized  detection 
system,  the  PDPO  decision  rule  of  the  k*''  detector  (Figure  4.4)  that  minimizes 
the  Bayesian  iiost  function  cissociated  with  the  global  decision  at  the  final  time  T 
is  given  by: 


T/Uyi)  ^l)  ~  '^k  —  ^  *7  '^(2/*)  >  Vk(^l) 


t\ 


0  otherwise 


for  all  k— 0,I,...,n;  t-T, 2,.. v/here  7/(.(f/.)  is  the  threshold  of  the  detector  at 
time  step  t  defined  as: 


(W{T,\)nnl\.)p{Il\Ih) 


i)  =:  l|w*  1,  Hi)  -  =  l|n‘  0,  /'/,) 


7  p(wo  14  =  ^  -  p(4  =  0. 


Proof: 


We  start  with  Equation  (4.4)  and  expand  it  in  terms  of  the  k^^'‘  decision  at  time 
step  t,  nl,  the  dt:cision  input  /;(,  the  observation  y(.,  and  the  global  deciidon  at  time 
step  t,  .is  follows; 


■4r)-  E 


.  ...W  .tl'*.— — — .MtHAii. 


(4.7) 


-C'dPC^O  =  1.  +  C 

Conditioning  on  «q,  u^,  and  yl,  Ec.  ation  (4.7)  is  rewritten  cis: 

•^(n=  i;  S^C,p(u^  =  l\ui,ulll,ylHo) 

xp(«o.“fc>yL7jj/ro) 

-Crfp(uJ  =  l|u*,ul,/i^,j/^,Fi) 

xp(no.nl.,  7*,yi.|/7i)  +  C  (4.8) 

Writing  the  cost  function  J(r)  of  (4.8)  explicitly  in  terms  of  all  the  possibilities  of 
the  global  decision  Uq  and  conditioning  further  on  II,  and  y(.,  we  have 

•^(^")  ==  12  Jyl  Qp(«o  =  1^0  =  IIo) 

xp(n‘  l|ui,yL/^,ifo)p(4,yL/^|/7o) 

-(7jp(r«J  1.|wS  =  i.  M!t7  pI  ■f^i) 

xp(4  •--  nuiii,yi,iiop(4,  n,pm) 

+C/p(ul’  =  l|u^  =  0,uj,,Il,yl,IIo) 

xpi^o  =  Olui,I^,yl,IIo)p(ul,Il,yHlfo) 

-C'cip(itJ  ==  liu^  =  a,uf^,/^,y^,>f7i) 
xp(Txf  =U|4,/j(,7/^,i7i)p(u'.,  -hC  (4.9) 

We  observe  that  the  final  global  decision  Uq  ~  1  given  the  global  decision  at  time 
C  1^0  ~  j  and  the  iiypothesis  Hi  does  not  depend  on  u^,  ![,  and  yj^.  Hence,  we 
rewrite  (4.9)  by  factoring  out  the  common  terms  and  substituting  p(uq  ~  0|.)  by 
1.  -p(ii(,  =  li.) 

'^(j") ""  fyl  Qp(4»yUi^liT„)b(^^o  ==  i|'4  ^  •  C/b) 

xp(ul,  i|wl.,yI.,i^,  /7o)  +  p(t£5  =  IK  0.  'b) 

x(l  -2J(«?,  -- 

•6',i/x((d.,w[.,4|7/,  )[p(uj-’  I  |uo  -  1,/7t) 

1  14 


y.p{u*o  =  +P(yo  = 

x(l  -p(«o  =  ^^i))]  +  C 


(4.1.0) 


Multiplying  out  the  term  (1  -p(uo  =  ^i-))  rearranging,  we  have 

W  =  X]  4i  Qp(«l.yk.^fcl'f^o)p(uo  = 

^k'^k 

xb{«0  ==  -■■  1.  ‘-^o)  -  p(«0  "  11«0  - 

+Cfpiul,yi,Il\HQ)p{u^  =  l|'«o  =  0>^o) 

~c,p{<,yiJfM)pH  -  yKyi,n,th) 

x[p(nj  1|«^  =  l,i?i)  ~  p(uj  =:  l|lif,  =:  0,  i?i)] 

~CMnlylIl\IIi)p{<'  =  l|t4  =  0,  H,)  -I-  C  (4.11) 

J  .itting  p{uq  =  l|iiQ  =:  1,  Hi)  —  p{Uq  =  Ijuj,  =  0,  Hi)  =  g^{T,i)  and  conditioning 
(4.11)  further  on  yl  and  ll,  v/e  have 

Jin  =  E  k  f^fpH\yi>  n,  iJo)p{yi  n\Ho) 

^■’'1 

xp(u^o=^llni,yUfl,Ho)grr,0) 

+6>«|yi,/;(,//o)p(3/L/^.|//o)p(t^b'’  =  1|«^  -  0,//o) 

~C,pWk,n,f^r}p(yl,niffi) 
xp(«‘  =- 114,  i/U  4.  1 ) 

“C'^p(4I!/L4,  ^i)p(pi./I-I^A)p(uo^  -  1|4  =  0,i7i)  +  C  (4.12) 

We  note  that  the  k‘^  detector  decision  ul  given  the  observation  gj.  and  the  decision 
input  fl  does  not  depend  on  tlic  h,  pothe-sis  pre.sent.  Next,  wc  rewrite  the  cost 
function  ^(1')  of  (4.12)  in  terms  of  all  possibilities  of  the  decision  uj.,  hence 

^(r)  -  E  4  pm  -  i|.yi.,  n)lCfP(yl,  niHa) 

x{p(4  ^  i|4  i-yylnlj  JJo)g‘(T,0)  •(■  p{u^'  i|'4  ==  o,/fo)} 

■CM?/I.,nuw  X  (pm  1  h4  -  1-4. 4,  f^)4('/’,  1) 


4-p(uo  ~  1|mo  ~  Oiifi)}]  —  0\yl,Il)[Cfp{yl,Il\HQ) 

x{p(wo  IK  0,yi,Il,Ho)gX^,0)  +  p{u^  -  IK  --  0,//o)} 

~'CdP{yU  ^  {P(^0  ~  ~  OiPfci  i^i^) 

■+■?(•.?  — 1 1^0  “  O' ^l)}]  +  ^  (4.13) 

We  observe  that  the  global  decision  at  time  t,  given  =  j  and  the  hypothesis 
Hi  does  net  depend  on  yj,  and  Ij.,  In  addition,  substituting  p{v,jf  —  by 

1  -p{u\  =  liyfc,/fc)  in  (4.13)  and  rearranging,  we  have 

y(r)  -  T.[i  Iy‘  p«  -  ilylt' 

X{p(u‘  -  1|4  -  l,^o)s'('^,0)+p(^/J  =  IK  =  OjJo)} 
-c,Myi,ni^tHp(4  - 11^1-  =  i,//i)5‘(r'i) 

+p(tto  —  l|uo  ~  0,//,)}  —  Cfp(yl,]^]Bo) 
xIpK  =  lh4  =  0,ffaMT,())  I- p(u^  -  I  Wo  =  0,^o)} 

+CMyi,n\Hi){p«  •-=  il4  =  0,//,)y‘(T,  1) 

+P(uj  =  ijuS  -  0,//0}1  +  6Vp(y[,  n\Ho) 

X  {p(«Q  =  i  14  -  O'  0)  +  p(4'  =  M4  =  0,  Ho)} 

-CMvU  n\ffi)  X  {pH  =--  ih‘/,  =  i) 

•bp(n,f  =  l|wo  =  0,  //i)}  f  C  (4.14) 

Wc  observe  that  the  last  three  terms  of  Equation  (4.14)  are  not  involved  in  the  op¬ 
timization  of  tlu!  detector.  We  di.scard  these  terms  in  the  subsequent  equations 
and  denote  the  nev/  cost  function  by  J*(r).  Rearranging  by  further  factorization 
of  common  terms  in  Equation  (4.14),  we  get 

■■  ■■  Y1  Jvi  pH  ^  UyU4)WfP(pL 

x{p(zi<0  -  114  -  iJWiT,0)  -hp(4f  =  1|4  -  Ojio) 

-pH  ^  ^  iN-'i  ~  0, //o).f/‘(j'>0)  -  p(uo  =  114  -  0,  //())} 

-C,piyl,mt){pH  -  lh4  -  1'  ‘^^:).4(T,1) 


+Pi'‘a  =  l|“o  =  *),ifi)  -pK  =  l|iii  =  l>,Hijg‘(T,l) 

-p(uJ  =  lW  =  0,J^,)}l  (4.15) 


Canceling  out  the  equal  terms  and  rearranging  by  further  factorization  of  common 
terms,  Equation  (4.15)  is  rewritten  as: 

=  E  kpi< 

x{p(«o  ^  ~  p{uq  =  1|4  =  0,  ^^o)} 

-C,p{yi,Il\Hr)g\T,l) 

X  {p(u(,  =  lj4  =  1,  Hr)  -  p{u*Q  l|u‘fc  0,  f/i)}]  (4.16) 

Letiing  p{njj  =  l|u[  =  1,  ^i)  —  p(«o  --  llw*  ~  0,  //,)  :==  we  rewrite  (4.16) 

a.s: 

-CMvin\fh)s'(r,\)f{ui,i)]  (4.17) 

The  cost  function  ./'(!')  of  (4.17)  is  minimized  if  we  choose 

P(''4  “  il2/A,M^ik)  =  I  if  >  Aj 

0  otharxmse  (4.18) 

where 

■<i  -C>(!/{,7'.|,f,), 7'(T,  ■■)/'(, ,i,i) 

Tio  -  QHsii./ii/zjj'cr,  ())/'(«;,  0) 

'fhe  detector  decision  rule  jK.)  of  the  generiil  system  is  given  by  rewriting 
(4.18)  a^j: 


tUpL  n)  -  4 


0 


otkarinisa 


(4.19) 
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where  ii\  is  the  threshold  of  the  detector  at  time  step  t  defined  as 

■  cwcr.iXf'K,!) 

Using  the  assumption  of  temporal  ^nd  spatial  independence  of  observations  in  the 
general  system,  the  detector  observation  y\.  is  independent  of  the  detector 
decision  input  /j[,.  Hence,  the  likelihoo<l  ratio  is  separable,  as  follnv/.s: 

A(/n 

Substituting  this  result  in  Equation  (4.19)  and  rearr;  ngiiig,  we  have 


tI  (,'/!•  1  ^1)  — ■  '4 


1  if  A(yD  > 

0  otherwise 


(4.20) 


where  multivalued  threshold  of  the  k^^  detector  at  time  step  t  defined 


riliO 


Cfy^{T^))r{ui,0)pirl\Ho) 


as  given  in  Equation  (4.6). 


(4.21) 


Q.E.D. 


It  should  be  n<7ted  that  F,qnation  (4.19)  represents  the  general  decision  rule  for 
any  detector  of  a  decentralized  detection  system  wnth  a^'  arbitrary  configuration. 
Moreover,  the  general  dt5ciuion  rule  of  any  detector  k  at  any  time  step  t  is  based 
on  the  likelihood  ratio  of  the  input  to  that  detector.  Thus,  the  decision  rule  at  the 
global  decision  ma.kei  can  be  olitaiiied  from  the  above  gcnc'ral  rc.sult.  'I'he  result 
is  given  next. 

Lemma  4.1: 


For  a  general  decentralized  detection  systen*  the  PHPt)  decision  rule  7(f(.)  of 
the  global  decision  maker  that  minimizes  the  Ijayesian  cost  function  for  the  binary 


hypothesis  testing  problem  is  given  by 


(^n*.  ?aT)  ==  «o  =  1  .  yJ)  > 

0  otherwise.  (4.22) 

where  /J  is  the  decision  input  of  the  global  decision  maker  and  t/q  is  the  input 
observation  of  the  global  decsision  maker  (if  any). 

Proof: 

The  global  decision  rule  of  (4.22)  results  directly  from  the  general  derision  rule 
(4.19)  by  letting  k  —  0,  t  -  T,  and  observing  the  following: 

(/{T,i)  =-■  p[xlI  -  IjnJ  \JIi)~p{ul  =  l|?i^  =  0,/f,) 

=  1  -  0  ==  1 

and  for  t=:l,2,...,T 

/‘("fh  0  l|«o  I7  lU)  -  p{u‘o  ■-  ih/f)  =  l>,  fli) 


Hence,  the  threshold  of  (4.19)  rednce.s  tn: 


Vk  ■  ,1 


resulting  in  F,(piation  (4.22). 


Q.K.D. 


Tlv  decision  rule  of  (4.22)  i.s  a  general  gloluil  decision  ride  in  that  ttie  global 
decision  maker  may  ahm  make  direct  ob.scrvatious  of  the  phenomenon  in  aiUlition 
to  the  derisions  rcceiv.-.d  froui  the  ot'uT  detectors.  'I'b.;!  observation  term  y*,  is  to 
be  dropperl  if  there  is  ue  diri:et  observation,  at  the  global  derision  tn.;»,.ker.  The 
result  of  beunua.  4.1  agree.s  with  the  global  derision  rnh:  ;i.t  tiiuc  strp  '1'  of  the  FHS 
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problem  given  in  Theorem  2.3  if  ./J  ~  is  used.  The  decision  rules  at,  the  local 
detectors  for  thtJ  FSS  problem  considered  in  Chapter  2  cati  also  be  obt.ained.  It  is 
demonstrated  in  Lemma  4.2. 


Lemma  4.2 

For  the  decentralized  detection  system  with  feedback,  the  decision  rule  at  the 
detector  for  the  FSS  problem  is  given  by  Theorem  4.1  with  ll  —  i.e., 


1  if  MVk)  >  rjliulr') 

0  otherwise 


for  k— -l,2,...,n  and  t— l,2,...,T;  where 


Proof: 


(4.23) 


It  is  seen  that  /y^(f,n)  is  the;  same  as  defiue<l  in  Theorem  2.4.  F,x])andiug 
i  —  lb  h  bi  terms  of  tlie  decision  vector  f/f.,  wt:  havi* 

f{ui,  i)  p(u(,  ~  Ijt^.  1,  /f,.)  -  =  l|n^  ^  0,  If) 


/'(4.0  -  Ep«  =  i-.bb)  -■!>{<  ---  -  tb^A) 

Conditioning  on  T/^,  ;uul  rearranging 

/‘(“I-  i)  ™  511  -■  M4  -  PiK  -■  i|'4-  "  lb  vi,  //,•)] 

xp(c^|//0 


01), serve  that  tlie  global  decision  tt',  given  all  of  the  local  decisions,  i.e.,  and  (ff., 
does  not  depend  on  tlu;  hypotliesis  present,  tience 

/*(^4, 0  =  ■  x:[fv4  -  -  1, 14)  -  pK  =  '  hi  -  h  mipifAm 

in 


ly.o 


tt  ^ • 'SSSeSf^lJt 


Note  that  [p(w^  =  Ijw'j.  =  l,Ul)  ~  p(u},  ~  l|u‘^  =  0,^7^)]  =  /(l/l)  as  defin'd  in 
Equation  (2.45).  Thus, 

Substituting  the  above  result  for  i  =  0,  1  in  Equation  (4.24)  and  recalling  the  spatial 
and  temporal  independence  of  observations  yields  Equation  (2.46)  of  Theorem  2.4. 

Q.E.D. 

Next,  we  turn  to  the  results  in  Section  2.3  where  the  FBPO  .solution  was 
obtained  without  the  knowledge  of  the  final  time  T.  In  other  words,  the  system 
was  optirni'^ed  with  the  as.sumption  that  the  decision  process  could  end  at  any  time 
t.  In  Lemma  4.3,  we  obtain  this  result  using  our  unified  approach. 

Lemma  4.3: 


For  the  docentraliiied  detection  system  with  feedback  but  without  memory,  tlie 
deci.sion  rule  at  the  det.'ctor  is  obtained  by  letting  /(.  =  and  time  .stei)  F 
=  t  in  'rheorem  4.1,  i.e., 


7lij/kiK~'^)  =••  4  =  1  Mj/D  >  4(4 

0  olhf'.vioisE 


(4.27) 


for  k— l,2,...,n;  where 


4(4r‘)- 


C//'i4,o)p(4“V^u) 


i)F(y(r  N'A) 


(4.28) 


Proof: 


As  explained  in  Example  4.5,  the  decision  input  to  the  <letector  /(,  is  given 
by  /(  —  'Che  result  of  substituting  1\  in  equatiou.s  (4.5)  and  (4.6) 

of  T'heorera  4.1  is  .straightforward.  Tho  result  of  .substituting  T  :  ;  t  needs  to  be 
exainijunl.  We  look  at  the  function  which  by  lotting  T  —  t,  wo  havt; 

//^((,  i)  p{v.l,  114,  ""  U  ff.)  ■  pH)  ■  ■  M'4)  d.  ff;) 


Using  the  facts  that 

p(«o  ==  11^0  =■■=  1.^-^.)  1 

p(u{,  =  l|u^  0,//i)  ==  0 
The  function  g^(T  ~  t,i)  =  1. 


Substituting  this  result  for  1  —  0,  I  in  Rqitation  (4.6)  yields  Equation  (4.28).  Fol¬ 
lowing  similar  steps  as  in  Lemma  4.2  for  the  development  of  f'(u[.,z),  the  threshold 
given  in  Equation  (4.28)  is  the  same  as  that  of  Equation  (2.6)  of  Theorem  2.2. 

Q.E.D. 

TL  ;  loca,l  and  global  decision  rules  of  Chapter  3  can  be  verified  in  a  .similar 
fa.shion..  The  communi cation  structure  of  the  decentraliz<  i  detection  system  with 
feedback  and  memory  is  the  same  as  that  of  the  system  without  memory.  Hence, 
the  deci.sion  rule  design  is  the  same  in  both  systems.  At  this  stage  we  turn  to  the 
results  in  tlie  literature  whore  we  look  at  the  general  formulation  attempted  by 
Reibman  and  Nolte  [9]  and  .sliow  that  their  results  are  a  special  case  of  our  results. 
It  should  be  not<;d  tliat  in  the  literature,  the  same  detector  at  two  dilferent  time 
in.stants  is  con.sidered  as  two  difF<Tent  <letectors.  lienee,  the  time  parameter  t  does 
not  £ieed  to  be  taken  into  account  here.  'I’he  result  is  presented  in  r.,emma  4.4  next. 

Lemma  4.4: 

For  the  binary  hypothesi.s  testing  problem  in  a  decentralized  detection  system, 
th«^  PRPO  decision  ruh;  <i.t  the  detector  (Figure  4.5)  tlia.t  miuimizc's  tin;  Ilayesian 
cost  function  of  the  final  global  decision  i.s  given  by: 

7k0/k,  4)  ~  I  if  A(y.O  >  rjkih) 

0  otln’.i'ii-i.'in  (4.2!)) 

where  4  is  the  decision  input  of  the  detector  and  r/(4)  tlu;  threshold  of  the 


Ilic  detector 


Figure  4.5:  Block  diat^nun  of  the  k^  detector  in  a  iziven  svyten.i. 


detector  defined  as: 


(j  y  _  Cff{u,,0)p{h\Ho) 

“  C,f{u,,l)pih\H^) 

and 

/(«fc,i)  =  p(«o  ~  M«fc  =  -p(“o  =-•  iK‘fc  =  o,jy,) 

Proof: 


(4.30) 


The  above  results  are  obtained  simply  by  dropping  the  superscript  t  in  the 
results  of  Theorem  4.1.  Since  in  this  formulation,  a  detector  operating  at  two 
different  time  instants  is  considered  as  two  different  detectors.  The  term  g*{7\  z)  = 
1  because  the  global  decision  maker  operates  only  once  (t— T).  It  should  be  noted 
that  the  results  of  Lemma  4.4  agree  with  that  of  Reibman  and  Nolte  [9]  with 
the  f{ukij)  term  in  Equation  (4.30)  expanded  over  all  possibilities  of  the  local 
decisions  that  are  input  of  the  global  decision  maker. 

Q.E.D. 

In  Lemma  4.5  next,  we  verify  the  rcsult.s  of  the  serial  .system  u.sing  Lcmm.:.  4.4. 
Lemma  4.5: 


For  a  serial  system  consisting  of  N  detectors,  the  detector  decision  rule  is 
given  by  r,emma  4.4  with  4  =  Ufc._i,  namely 


-  I  if  i^ivk)  :>  Vkifik-i) 
0  otherwise 


where  r}{uk-i)  is  the  threshold  of  the  fletector  defined  as: 

\  ^  CfJ{ui^)'^Uk-i\IIo) 


(4.31) 


(4.32) 


f[uk^^)  =  p(no  ==  i|ufc  1,  Hf)  -  p{uvt  ■■=  !|?rfc  0,  lU) 

I.X.4 


and 


Proof: 


The  above  results  are  obtained  by  a  straightforward  substitution  of  Ik  =  ut-i 
in  Lemma  4.4.  It  should  be  observed  that  the  detector  corresponds  to  the 
detector  in  the  serial  system.  Furthermore,  for  k— 1,  there  is  no  decision  input 
Ik,  and  for  k-0,  the  term  j{uk,j)  ~  1  resulting  in  the  decision  rule  at  the  final 
detector. 

q.E.D. 

In  order  to  demoustratv^  tlie  versatility  of  our  appro.-ich,  we  apply  it  to  a  more 
complex  decentralizf'd  defection  configuration  n(!xt. 

4.3.3  Decentralized  Detection  with  Peer  Communication 

We  consider  the  binary  hypothesis  testing  problem  for  tiu;  (lecentralized  detectitju 
system  with  peer  corarnuuication  .shown  in  Figure  4.6.  In  this  .system,  the  lo¬ 
cal  detector  communicates  its  dcci.sion  to  the  global  decision  makei  as  well  as  all 
other  local  detectors.  The  .system  operates  iis  follows:  At  time  .step  t,  the  local 
detector  tnakes  the  loca,l  dcci.sion  u[.  b.-nsod  on  its  current  observation  7/[,  its  previ¬ 
ous  observations  and  other  detector  decisions  . . . ,  . . . , 

that  arc:  transmitted  to  it.  Let  the  jnimbc;r  of  local  detcjctors  be  a.  The  uuml>c;r 
of  levc;ls  for  this  sy.stem  is  the  .same  as  that  of  the  conventional  decentralized  de¬ 
tection  systaun  c)f  Fxample  4.4,  hence  the:  same  tinu;  indices  are  obtaiiuid.  The 


l>”) 


I 
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Fig.  4.6:  A  decentralized  detection  system  with  peer  communication 


coinniuiuciition  matrix  1)  is,  tlmrefore,  given  by 


1  1 

^0  !•••  1  1 

1  2 

1  0  1  •  1  1 

1  3 

110  1  ••  1 

1  n 

1  !•••  1  01 

2  0 

1^0  O---  0  0  0/ 

Observe  that  the  0'^  detector  (the  global  rledsion  maker)  dees  not  transmit  its 
decision  to  the  other  df’tectors  (row  elements  are  ail  0).  The  decision  input  of  the 
detector  corresponding  to  column  k  is  therefore  given  by: 

II  , . . . ,  '4--M1  •  •  •  )  detector  k. 

The  decision  rule  of  the  detector  is  presented  in  Lemma  4.6  next. 

LemjTia  4,6 


I'br  the  binary  hyp(^the.si.s  testing  problem  of  a  decentralized  detection  .systein 
with  peer  communication  shown  in  Kigure  4.6,  the  PBPO  dc'cision  rule  of  the 
local  detector  tlurt  minimizes  the  iiayesiau  cost  function  i,s  given  by  'I’heorem  4.1 
with  T'--t,  namely 


t  /  if  ^ 


0  of.  hewn  SK 

where  t/KID  i.s  the  threshold  at  time  .step  t  dolincd  as 

Cff{ni,0)p(mo) 


(4.34) 


r-.  p{u^^  lju[.  1,  R;)-p{un  1  |7ff.  0,  H,) 


(4.34) 


n 


-  u. 


I  •  •  ■ )  )  •  •  • » ^  hjcfi/  detector  k 


Proof: 


Straightforward  substitution  of  . . . ,  . . . ,  k— 

and  T=t  in  Thee*  eni  4.1  yields  thv  desired  decision  rule  of  Lemma  4.6.  The 
decision  rule  of  the  global  decision  maker  is  the  same  as  that  of  the  conventional 
decentralized  detection  system  since  the  available  information  at  the  global  decision 
maker  are  the  sa,ine. 

Q.E.D. 

Next,  we  present  a  numerical  example  utilizing  the  results  obtained  for  the 
decentralized  detect'ori  system  with  peer  communication  and  compare  the  perfor¬ 
mance  to  the  i:o"veutional  decentralized  detection  system  and  the  decentralized 
detection  system  with  feedback  and  memory. 

Example  4.6; 

VVe  pursue  the  example  of  Chapter  3.  Briefly,  the  system  consists  of  two  local 
detectors  and  a  fucion  center.  The  Oil  fusion  rule  is  used.  The  input  observations 
are  aa.suuied  to  iiave  a  Rayleigh  distribution.  'I'lie  probability  of  error  pi  for  this 
system  is  given  by 

pi  plnPiHi)  +  p'fPi^o)  (4.35) 

where  and  are  the  system  probability  of  mi  s  and  false  alarm  respectively. 
Sin -e  ftrsion  rule  is  the  OR  rule,  the  error  probabilities  can  be  written  in  terms 
of  the  local  detector  error  probabilitiKi  and  as  follows 

pI  ---  (T’L.)"  (4.36) 

and 

pU.:|..(J-.p^)^  (4.37) 

1.25 


for  i=.l,  tli«  local  detector  probability  of  rniss  at  time  t,  is  by  condi¬ 

tioning  on  the  second  detector  decision  at  time  t  1,  as  follows 

pI.  -  v{n\  - 

-  !:„<->  =  0|^zr^  HMu\~^\Fh)  (4.38) 

Expanding  in  terms  of  all  possibilities  of  U2  we  have 

•■=  pK  -=  0|ur‘  -  Uih)p{u\-^  =:  lii/l) 

■fp(«(  =  0|ur*  =  0,  Hr)p{a^^~^  =  Ol.ffa)  (4.39) 

Substituting  p(t4'’'  =  l|/'''i)  —  1  ~p{u2~^  —  0|//j)  and  rearranging,  we  have 

Fm,  =  )[?(«(  =  0i«2~'  =  0,  ^1)  -  P(«'i  fifi)] 

-^p(u‘  =0|ur'  =  l,^i)  (4.40) 

Since  local  detet;i,ors  are  assumed  to  have  equal  SNR,  the  following  holds 


p((4  ‘  0|//i)  ---= 


Hence,  Equation  (4.40)  is  rewritten  as 


=  Fm'’[Pm,(«'  ‘  =  0)  -  p(„.(u‘  ^  1)] 


=  1) 


(4.41; 


Similarly,  the  prol)ability  of  false  alarm  of  the  local  detect(;r  is  given  by 


(4-42) 

Substituting  Equations  (4.41)  and  (4,42)  in  (4.36)  and  (4.37)  and  then  substituting 
the  results  in  (4.35)  yields  the  system  probability  of  error. 


The  probability  of  (;rror  v.s.  SNR  is  plotted  in  Figure  4.7  for  vari  us  values  of 
the  nmnber  of  samples  p(T  det(;et.or.  Moreover,  for  the  HNR,  valuf.;  of  5  dll,  'vc  i)lot 
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tlie  system  probability  of  error  vs.  the  number  of  observation  samples  per  detector 
in  Figure  4.8  for  the  decentralized  detection  system  witii  pe<3r  communication, 
the  conventional  decentralized  detection  system  and  the  decentralized  detection 
system  with  feedback  and  memory. 

The  plot  in  Figure  4.7  shows  that  the  probability  of  error  for  the  decentralized 
detection  system  with  peer  communication  decreases  as  the  number  of  samples  per 
detector  increases  and  SNR  value  increases.  The  plot  in  Figure  4.8  sh')ws  the  prob¬ 
ability  of  error  for  thrc^e  decentralized  detection  systems  for  the  SNR  value  of  5dB. 
It  is  seen  that  the  probability  of  error  of  the  decentralized  detection  system  with 
peer  communication  is  less  than  that  of  the  conventional  decentralized  detection 
system.  On  the  other  hand,  the  decentralized  detection  system  with  feedback  and 
memory  has  the  least  probability  of  error  for  a  given  number  of  samples.  .Similzir 
results  for  the  AND  fusion  rule  are  obtained.  The  probability  of  error  vs.  SNR  is 
ploted  in  Figure  4.10.  In  Figure  4.9,  the  probability  of  error,  for  the  SNR  value  of 
5,  is  ploted  for  the  decentralized  deter-.tion  system  with  peer  communication,  the 
system  with  feedback,  and  the  conventional  decentralized  detection  system. 

It  should  be  noted  that  for  the  case  of  two  local  detectors,  the  dtjcentralized  de¬ 
tection  system  with  fee<lback  and  memory  oixtperforms  the  decentralized  detection 
system  with  peer  conuuunicatiou.  Intuitively  however,  the  decentralized  detection 
system  with  peer  communication  .should  outperform  the  decemtral’zed  detection 
system  with  feedback  and  memory,  which  is  the  cexse  when  tin;  system  has  more 
tliiiii  two  locyJ  d^3t<jc‘orH, 

4.4  Discussion 


In  this  chrapter,  we  have  presented  a  unified  approach  to  the  study  of  a  decentral¬ 
ized  detecti()n  sysl.iun  with  any  configuration.  In  this  approach,  wi;  repreiient  the 
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Figure  4.9:  Probability  of  error  for  the  system  with  peer  communication. 
AND  rule 


interconnection  between  detectors  in  a  decentralized  detection  system  by  a  corn 
nmnication  matrix.  Based  on  this  representation,  we  have  derived  a.  general  PBPO 
decision  rule  at  any  detector  of  a  decentralized  detection  system  with  any  conlrgu- 
ration.  It  was  demonstrated  that  tlie  unified  approach  can  be  used  to  obtain  results 
from  earlier  chapters  as  well  as  ^e^:ults  available  in  the  literature.  A  new  topolog¬ 
ical  structure  namely  a  de.  entrali  -.ed  detection  system  with  peer  conjmmiication 
was  considered  in  detail  and  its  performance  was  evaluated.  Numerical  results 
were  also  obtained  for  the  ca.se  of  two  d<;tcr,tors  and  a  fusion  center.  Our  ri;.sulta 
in  this  chapter  provide  a  versatile  tool  for  the  design  and  analysis  of  decentralized 
detection  systems. 


Chapter  5 


Summary  And  Suggestions  For 
Future  research 


5.1  Summary 

In  this  dissertation,  we  have  considered  the  binary  hypothesis  testing  proi)lem  for  a 
df^centraiized  detection  system  with  feedback  consisting  of  n  local  detectcirs.  Using 
the  Bayesian  formulation,  we  derived  the  local  and  the  global  decision  rules.  An 
expression  for  t.h<^  Hyr,t(?ra  proba.bi*ir,y  of  error  was  also  dt:riv''d.  It  was  shown  that 
as  tire  uiuiibi^r  of  obsorvatiou  saiuples  incrc'Oijcd,  the  systian  probability  of  error 
decreased  at  a  slower  rate  than  that  of  a  conventional  decentralized  detection 
system.  The  FSS  problem  was  investigated  where  the  stopping  time  was  known  a 
priori.  Local  and  global  thresliold  equations  were  derived  and  shown  to  be  coupled 
spatially  and  temporally.  Tlie  single  detector  system  with  fcedbiick  was  studied. 
Tlu!  decision  rule  of  the  single  detector  was  derivtxl  for  the  FSS  problem,  it  was 
shown  that  the  single  detector  .system  with,  feedback  corresponds  to  a  serial  system 
consisting  ot  N  (h.i.ectors.  The  decision  rule  at  tiuu^  step  t  of  the  single  detector 

i.'u; 


system  ./ith  feedback  was  sbowu  to  be  the  same  as  the  decision  rule  of  the 
detector  of  a  serial  network.  Ilcncc,  results  of  the  decentralized  detection  system 
with  feedback  could  be  extended  to  networks  with  blocks  of  detectors  in  tandem. 

Next,  a  decentralized  detection  system  with  feedback  incorporating  memory 
at  the  local  detectors  was  investigated.  Using  the  PBPO  solution  methodology, 
local  and  global  decision  rules  were  derived.  The  iiystern  probability  of  error  for  this 
system  was  shown  to  be  .at  least  as  good  as  the  conventional  decentralized  detection 
system  without  feedback.  Asymptotic  behavior  of  the  system  probability  of  error 
was  considered.  It  was  shown  that  as  the  number  of  observations  goes  to  infinity 
the  system  probabiliy  of  error  goes  to  zero.  Due  to  the  feedback  links,  an  increase 
in  data  transmission  is  exhibited.  Two  protocols  were  proposed  and  studied  for 
the  reduction  ol  data  transmission.  It  was  shown  that  the  average  number  of 
decision  transmissions  goes  to  zero  as  the  number  of  samples  goes  to  infinity.  For 
a  decentralized  detection  system  with  feedback  and  memory,  the  .system  probability 
of  error  and  the  average  number  of  decision  transmission  were  considerably  better 
than  that  of  the  corresponding  system  without  memory. 

Finally,  we  presented  the  definition  of  the  conjmunication  .structure  of  decen¬ 
tralized  detection  .systems.  Then,  using  the  Bayesian  formulation  and  the  PBPO 
sohition  methodology,  the  FSS  problem  was  .solve.tl  for  a  docentr.alized  detection 
system  with  an  arbitrary  configuration.  We  derived  the  decision  rules  for  a  gen¬ 
eral  decentralized  detection  .system.  Using  these  decision  rules,  we  verified  various 
results  from  the  literature  as  well  as  the  decentralized  detection  system  with  heed- 
back.  Using  our  new  definition  alongwith  our  decision  rule  design  approach,  we 
established  a  unified  approach  to  the  design  and  .study  of  decentralized  ded-ection 
systems. 

There  are;  two  major  contributions  of  this  dis.sertatiou.  'The  finst  one*  is  the; 
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demonstration  of  the  fact  that  the  performance  of  a  decentralized  detection,  system 
can  be  improved  by  the  use  of  feedback.  This  improvement  is  aohie\^Hi  at  the 
expense  of  increased  communication.  The  other  major  contribution  is  a  unified 
representation  of  decentralized  detection  system  with  any  topology  along  with  an 
approach  to  obtain  the  PBPO  decision  rules  at  any  detector  of  the  decentralized 
detection  system. 

5.2  Su{5gestions  For  Future  Research 

Throughout  this  dissertation,  v/e  have  assumed  that  the  observations  at  the  lo¬ 
cal  detectors  .am  .statistically  independent  and  Kleni'.ic.'dly  di.stributcd.  In  practice, 
however,  spatial  and  temporal  dependence  of  observations  can  be  expected.  Tliere- 
fore,  a  fruitful  area  of  research  is  to  optimize  the  decentralized  detection  system 
with  feedback  under  the  appropriate  dependent  observation  models.  Another  pos¬ 
sibility  is  to  investigate  the  non  parametric  problem  in  a  decentralized  detection 
system  with  feedback.  Proper  decision  rules  mu.st  be  developed  for  this  case. 

The  design  of  optimum  decentralized  detection  system-s  is  computationally 
quite  intensive.  It  usually  involves  solutions  of  coupled  nonlinear  equations  to 
determine  the  thresholds.  Computationally  efficient  approaches  for  the  design  of 
optimum  (or  near-optimum)  der.tMitraliz.  :d  detection  systems  should  be  developed. 
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